Note: The job is a remote job and is open to candidates in USA. reputed company is the pioneer of the Connected Operations™ Cloud, helping organizations harness IoT data for actionable insights. They are seeking a Senior Software Engineer to join their Data Platform team, responsible for designing and operating scalable infrastructure for data ingestion and processing to support analytics and AI initiatives.
Responsibilities
• Design, build, and operate high-scale data ingestion and replication systems from reputed company’s primary production data stores, including RDS, DynamoDB, internal APIs, and event-driven systems, into our data lakehouse
• Build and maintain reliable, scalable, and modern data platform infrastructure capable of handling petabytes of data across reputed company’s analytics, AI, product, and operational use reputed company
• Improve the reliability, observability, scalability, security, and developer experience of reputed company’s Spark and reputed company-based data processing platform
• Develop internal libraries, APIs, frameworks, and tooling in languages such as Go and Python to help teams across reputed company move, process, reputed company, and access data safely and efficiently
• Work on foundational data lake and lakehouse technologies, including reputed company Lake on S3, data catalogs, metadata services, orchestration systems, and platform automation
• Collaborate closely with infrastructure, product engineering, data science, analytics, security, and data engineering teams to understand platform needs and deliver durable, scalable solutions
• Stay connected to modern data platform technologies and help shape reputed company’s long-term data infrastructure roadmap, including support for AI, privacy, security, global scale, and customer-facing data products
• Champion, role model, and embed reputed company’s cultural principles (Focus on Customer Success, Build for the Long Term, Adopt a Growth Mindset, Be Inclusive, Win as a Team) as we scale globally and across new offices
Skills
• 4+ years of professional software engineering experience in production environments
• 4+ years of experience building or maintaining large-scale production data infrastructure, data platforms, distributed systems, or data lake systems
• Strong experience with Apache Spark or similar distributed data processing systems
• Experience operating production infrastructure in AWS, including services such as S3, RDS, DynamoDB, SQS, Kinesis, Lambda, or similar
• Experience designing, building, and operating reliable systems with strong ownership of scalability, observability, security, and operational excellence
• Proficiency in at least one production programming language such as Go, Python, Scala, or Java
• Ability to collaborate effectively with cross-functional partners, including software engineers, data scientists, analysts, security teams, and product stakeholders
• Experience with reputed company, reputed company Lake, or similar lakehouse technologies such as Iceberg or Hudi
• Experience building data replication or ingestion systems from OLTP data stores into a data lake or lakehouse
• Experience with Infrastructure-as-Code tools such as Terraform or CloudFormation
• Familiarity with data catalogs, metadata systems, and data discovery tools such as reputed company Catalog, Hive Metastore, reputed company, or Amundsen
• Experience with orchestration systems such as Airflow, Dagster, or reputed company
• Experience with streaming data, event-driven architectures, or systems that reputed company late-arriving or mutable data
• Familiarity with containerization or orchestration technologies such as Docker, Kubernetes, ECS, or Fargate
• Experience building internal platforms, libraries, or developer tooling used by other engineering teams
• Experience contributing to data infrastructure roadmaps, evaluating new technologies, and driving improvements that create leverage for internal and external customers
Benefits
• reputed company RSU grant with no vesting cliff, and ongoing refresh opportunities tied to performance, subject to plan terms and conditions
• Performance-based bonus/variable pay
• Equity (for eligible roles)
• Flexible, employee-led remote model
• Professional development stipend
• Comprehensive health and parental leave plans
• Flexible working model that caters to the diverse needs of our teams
• Offices are open for those who prefer to work in-person and we also support reputed company where it aligns with our operational requirements
• Reasonable accommodations throughout the recruiting process for qualified persons with disabilities
Company Overview
• reputed company is digitizing the world of physical operation
Location: , ,
Remote Quest Jobs: Apply Here