Staff Engineer - Senior Data Engineer

Role - Senior Data Engineer
Location - Remote USA
Employment type - Fulltime

Job Summary:

• We are looking for an experienced Data & AI Architect with strong expertise in Databricks, AWS, Enterprise Data Architecture, PySpark, and AWS Bedrock.
• The candidate will be responsible for designing scalable, secure, and governed data and AI solutions across the enterprise.
• The role requires a strong understanding of modern data platforms, data modelling, data governance, data products, ETL, APIs, and cloud-native/serverless architectures, along with hands-on experience in emerging GenAI, AI Agents, AWS Bedrock, and Databricks Genie capabilities.

Key Responsibilities:

• Design and implement scalable enterprise data architectures using Databricks and AWS platforms.
• Define data architecture patterns covering data ingestion, processing, storage, transformation, serving, and consumption.
• Design and optimize data models, data marts, data warehouses, and enterprise data platforms.
• Establish and implement data governance, security, quality, lineage, and access-control frameworks. Develop and optimize data processing pipelines using PySpark, SQL, and ETL frameworks. Work with Databricks capabilities for data engineering, analytics, AI/ML, and data product enablement.
• Design cloud-native and serverless solutions on AWS using appropriate AWS services.
• Architect and integrate solutions using APIs and API-based data integrations.
• Work with AWS Bedrock to design and enable GenAI and AI-agent-based solutions.
• Provide architecture guidance for AI Agents, Databricks Genie, and enterprise GenAI use cases.
• Design solutions that enable reusable, scalable, and governed data products for business and analytical consumption.
• Perform SQL query optimization, performance tuning, and data-processing optimization.
• Collaborate with Data Engineers, Data Scientists, AI/ML Engineers, Product Owners, and business stakeholders to translate business requirements into scalable technical solutions.
• Define architecture standards, reusable patterns, technical documentation, and best practices.
• Conduct technical reviews and provide guidance to development teams on architecture, performance, scalability, and maintainability.
• Ensure solutions align with enterprise security, governance, compliance, and cloud architecture standards.