Principal Developer - StarRocks
Atlassian
Principal Developer - StarRocks
Job Description
Principal Developer - StarRocks
📋 Job Overview
Join our Developer Observability team as a Principal Developer for StarRocks. You will architect, operate, and optimize large-scale StarRocks deployments for real-time analytics and observability. This role demands deep expertise in StarRocks internals, performance tuning, and integration with modern data pipelines.
📍 Location: Sydney, Australia
🏢 Category: Engineering
📅 Posted: 2025-12-10 04:39 AM
🎯 Key Responsibilities
- Design, build, and maintain production-grade StarRocks clusters for high-volume, low-latency analytics workloads
- Lead schema/data modeling for clickstream, dimensional, and time-series data, ensuring deduplication, upserts, and efficient partitioning
- Optimize query performance using materialized views, indexes, and advanced StarRocks features (vectorization, pipeline execution)
- Diagnose and resolve high-severity incidents, leveraging logs, metrics, and profiling tools; implement permanent fixes and guardrails
- Plan and execute capacity planning, scaling, and resource management for multi-tenant environments
- Develop and enforce backup, disaster recovery, and upgrade strategies with minimal downtime
- Implement security best practices: AuthN/AuthZ, encryption, auditing, and data masking
- Collaborate with engineering and SRE teams to define SLOs, observability dashboards, and alerting for StarRocks infrastructure
✅ Required Qualifications
- Proven experience architecting and operating StarRocks (or similar OLAP) clusters at scale (10B+ events/day, TB–PB data)
- Deep understanding of StarRocks FE/BE architecture, storage engines, compaction, and cost-based optimizer
- Expertise in schema design, partitioning, bucketing, and index/encoding strategies for hot/cold data tiers
- Strong troubleshooting skills: root cause analysis, performance profiling, and incident response
- Experience with ingestion pipelines (Kafka/Kinesis), exactly-once semantics, and CDC-based upserts
- Familiarity with materialized view design, refresh policies, and query rewrite mechanics
- Operational excellence: backup/restore, rolling upgrades, resource governance, and multi-tenant management
- Security and compliance: LDAP/OIDC integration, RBAC, encryption, and sensitive data handling
- Excellent communication skills; ability to diagram architectures and explain trade-offs to technical and non-technical stakeholders
⭐ Preferred Qualifications
- Experience with other OLAP systems (ClickHouse, Druid, Pinot) and comparative benchmarking
- Contributions to StarRocks open source or related communities
- Cloud-native deployment experience (Kubernetes, autoscaling, infrastructure-as-code)
🛠️ Required Skills
- StarRocks
- OLAP
- schema design
- partitioning
- bucketing
- index/encoding
- troubleshooting
- root cause analysis
- performance profiling
- incident response
- Kafka
- Kinesis
- exactly-once semantics
- CDC
- materialized views
- query rewrite
- backup/restore
- rolling upgrades
- resource governance
- multi-tenant management
- security
- compliance
- LDAP
- OIDC
- RBAC
- encryption
- sensitive data handling
- communication
- architecture diagramming
- ClickHouse
- Druid
- Pinot
- benchmarking
- open source contributions
- Kubernetes
- autoscaling
- infrastructure-as-code
Locations
- Sydney, Australia
Salary
Estimated Salary Rangemedium confidence
180,000 - 250,000 AUD / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- StarRocksintermediate
- OLAPintermediate
- schema designintermediate
- partitioningintermediate
- bucketingintermediate
- index/encodingintermediate
- troubleshootingintermediate
- root cause analysisintermediate
- performance profilingintermediate
- incident responseintermediate
- Kafkaintermediate
- Kinesisintermediate
- exactly-once semanticsintermediate
- CDCintermediate
- materialized viewsintermediate
- query rewriteintermediate
- backup/restoreintermediate
- rolling upgradesintermediate
- resource governanceintermediate
- multi-tenant managementintermediate
- securityintermediate
- complianceintermediate
- LDAPintermediate
- OIDCintermediate
- RBACintermediate
- encryptionintermediate
- sensitive data handlingintermediate
- communicationintermediate
- architecture diagrammingintermediate
- ClickHouseintermediate
- Druidintermediate
- Pinotintermediate
- benchmarkingintermediate
- open source contributionsintermediate
- Kubernetesintermediate
- autoscalingintermediate
- infrastructure-as-codeintermediate
Required Qualifications
- Proven experience architecting and operating StarRocks (or similar OLAP) clusters at scale (10B+ events/day, TB–PB data) (experience)
- Deep understanding of StarRocks FE/BE architecture, storage engines, compaction, and cost-based optimizer (experience)
- Expertise in schema design, partitioning, bucketing, and index/encoding strategies for hot/cold data tiers (experience)
- Strong troubleshooting skills: root cause analysis, performance profiling, and incident response (experience)
- Experience with ingestion pipelines (Kafka/Kinesis), exactly-once semantics, and CDC-based upserts (experience)
- Familiarity with materialized view design, refresh policies, and query rewrite mechanics (experience)
- Operational excellence: backup/restore, rolling upgrades, resource governance, and multi-tenant management (experience)
- Security and compliance: LDAP/OIDC integration, RBAC, encryption, and sensitive data handling (experience)
- Excellent communication skills; ability to diagram architectures and explain trade-offs to technical and non-technical stakeholders (experience)
Preferred Qualifications
- Experience with other OLAP systems (ClickHouse, Druid, Pinot) and comparative benchmarking (experience)
- Contributions to StarRocks open source or related communities (experience)
- Cloud-native deployment experience (Kubernetes, autoscaling, infrastructure-as-code) (experience)
Responsibilities
- Design, build, and maintain production-grade StarRocks clusters for high-volume, low-latency analytics workloads
- Lead schema/data modeling for clickstream, dimensional, and time-series data, ensuring deduplication, upserts, and efficient partitioning
- Optimize query performance using materialized views, indexes, and advanced StarRocks features (vectorization, pipeline execution)
- Diagnose and resolve high-severity incidents, leveraging logs, metrics, and profiling tools; implement permanent fixes and guardrails
- Plan and execute capacity planning, scaling, and resource management for multi-tenant environments
- Develop and enforce backup, disaster recovery, and upgrade strategies with minimal downtime
- Implement security best practices: AuthN/AuthZ, encryption, auditing, and data masking
- Collaborate with engineering and SRE teams to define SLOs, observability dashboards, and alerting for StarRocks infrastructure
Tags & Categories
Principal Developer - StarRocks
Atlassian
Principal Developer - StarRocks
Job Description
Principal Developer - StarRocks
📋 Job Overview
Join our Developer Observability team as a Principal Developer for StarRocks. You will architect, operate, and optimize large-scale StarRocks deployments for real-time analytics and observability. This role demands deep expertise in StarRocks internals, performance tuning, and integration with modern data pipelines.
📍 Location: Sydney, Australia
🏢 Category: Engineering
📅 Posted: 2025-12-10 04:39 AM
🎯 Key Responsibilities
- Design, build, and maintain production-grade StarRocks clusters for high-volume, low-latency analytics workloads
- Lead schema/data modeling for clickstream, dimensional, and time-series data, ensuring deduplication, upserts, and efficient partitioning
- Optimize query performance using materialized views, indexes, and advanced StarRocks features (vectorization, pipeline execution)
- Diagnose and resolve high-severity incidents, leveraging logs, metrics, and profiling tools; implement permanent fixes and guardrails
- Plan and execute capacity planning, scaling, and resource management for multi-tenant environments
- Develop and enforce backup, disaster recovery, and upgrade strategies with minimal downtime
- Implement security best practices: AuthN/AuthZ, encryption, auditing, and data masking
- Collaborate with engineering and SRE teams to define SLOs, observability dashboards, and alerting for StarRocks infrastructure
✅ Required Qualifications
- Proven experience architecting and operating StarRocks (or similar OLAP) clusters at scale (10B+ events/day, TB–PB data)
- Deep understanding of StarRocks FE/BE architecture, storage engines, compaction, and cost-based optimizer
- Expertise in schema design, partitioning, bucketing, and index/encoding strategies for hot/cold data tiers
- Strong troubleshooting skills: root cause analysis, performance profiling, and incident response
- Experience with ingestion pipelines (Kafka/Kinesis), exactly-once semantics, and CDC-based upserts
- Familiarity with materialized view design, refresh policies, and query rewrite mechanics
- Operational excellence: backup/restore, rolling upgrades, resource governance, and multi-tenant management
- Security and compliance: LDAP/OIDC integration, RBAC, encryption, and sensitive data handling
- Excellent communication skills; ability to diagram architectures and explain trade-offs to technical and non-technical stakeholders
⭐ Preferred Qualifications
- Experience with other OLAP systems (ClickHouse, Druid, Pinot) and comparative benchmarking
- Contributions to StarRocks open source or related communities
- Cloud-native deployment experience (Kubernetes, autoscaling, infrastructure-as-code)
🛠️ Required Skills
- StarRocks
- OLAP
- schema design
- partitioning
- bucketing
- index/encoding
- troubleshooting
- root cause analysis
- performance profiling
- incident response
- Kafka
- Kinesis
- exactly-once semantics
- CDC
- materialized views
- query rewrite
- backup/restore
- rolling upgrades
- resource governance
- multi-tenant management
- security
- compliance
- LDAP
- OIDC
- RBAC
- encryption
- sensitive data handling
- communication
- architecture diagramming
- ClickHouse
- Druid
- Pinot
- benchmarking
- open source contributions
- Kubernetes
- autoscaling
- infrastructure-as-code
Locations
- Sydney, Australia
Salary
Estimated Salary Rangemedium confidence
180,000 - 250,000 AUD / yearly
Source: ai estimated
* This is an estimated range based on market data and may vary based on experience and qualifications.
Skills Required
- StarRocksintermediate
- OLAPintermediate
- schema designintermediate
- partitioningintermediate
- bucketingintermediate
- index/encodingintermediate
- troubleshootingintermediate
- root cause analysisintermediate
- performance profilingintermediate
- incident responseintermediate
- Kafkaintermediate
- Kinesisintermediate
- exactly-once semanticsintermediate
- CDCintermediate
- materialized viewsintermediate
- query rewriteintermediate
- backup/restoreintermediate
- rolling upgradesintermediate
- resource governanceintermediate
- multi-tenant managementintermediate
- securityintermediate
- complianceintermediate
- LDAPintermediate
- OIDCintermediate
- RBACintermediate
- encryptionintermediate
- sensitive data handlingintermediate
- communicationintermediate
- architecture diagrammingintermediate
- ClickHouseintermediate
- Druidintermediate
- Pinotintermediate
- benchmarkingintermediate
- open source contributionsintermediate
- Kubernetesintermediate
- autoscalingintermediate
- infrastructure-as-codeintermediate
Required Qualifications
- Proven experience architecting and operating StarRocks (or similar OLAP) clusters at scale (10B+ events/day, TB–PB data) (experience)
- Deep understanding of StarRocks FE/BE architecture, storage engines, compaction, and cost-based optimizer (experience)
- Expertise in schema design, partitioning, bucketing, and index/encoding strategies for hot/cold data tiers (experience)
- Strong troubleshooting skills: root cause analysis, performance profiling, and incident response (experience)
- Experience with ingestion pipelines (Kafka/Kinesis), exactly-once semantics, and CDC-based upserts (experience)
- Familiarity with materialized view design, refresh policies, and query rewrite mechanics (experience)
- Operational excellence: backup/restore, rolling upgrades, resource governance, and multi-tenant management (experience)
- Security and compliance: LDAP/OIDC integration, RBAC, encryption, and sensitive data handling (experience)
- Excellent communication skills; ability to diagram architectures and explain trade-offs to technical and non-technical stakeholders (experience)
Preferred Qualifications
- Experience with other OLAP systems (ClickHouse, Druid, Pinot) and comparative benchmarking (experience)
- Contributions to StarRocks open source or related communities (experience)
- Cloud-native deployment experience (Kubernetes, autoscaling, infrastructure-as-code) (experience)
Responsibilities
- Design, build, and maintain production-grade StarRocks clusters for high-volume, low-latency analytics workloads
- Lead schema/data modeling for clickstream, dimensional, and time-series data, ensuring deduplication, upserts, and efficient partitioning
- Optimize query performance using materialized views, indexes, and advanced StarRocks features (vectorization, pipeline execution)
- Diagnose and resolve high-severity incidents, leveraging logs, metrics, and profiling tools; implement permanent fixes and guardrails
- Plan and execute capacity planning, scaling, and resource management for multi-tenant environments
- Develop and enforce backup, disaster recovery, and upgrade strategies with minimal downtime
- Implement security best practices: AuthN/AuthZ, encryption, auditing, and data masking
- Collaborate with engineering and SRE teams to define SLOs, observability dashboards, and alerting for StarRocks infrastructure
Tags & Categories