- Years of experience: 12 to 15 years
Focus: Strategy, Security, Governance, and Scalability. The Architect ensures the pipeline is secure, cost-efficient, and meets enterprise standards.
- Key Responsibilities:
- Design the end-to-end logical and physical data architecture.
- Define Data Governance policies and metadata management strategies.
- Select the cloud service tiers to balance performance with cost optimization.
- Data Contracts to ensure seamless handoffs between engineering and science.
- Deliverables: High-Level Design (HLD) documents, Data Lineage Maps, Security & Compliance Audits.
- Tech Stack - AWS
- Data Ingestion & Processing : AWS API Gateway, AWS Lambda, AWS Glue ETL, AWS Glue Crawler
- Data Storage & Analytics : Amazon S3, Amazon Redshift (Data Warehouse), Amazon Athena
- Governance & Security : AWS Lake Formation, AWS IAM, AWS CloudTrail, Amazon CloudWatch
- AI & Analytics : AWS Bedrock
- Infrastructure & Architecture : AWS CloudFormation, Data Modeling Tools (SQLDBM or similar)
- Visa Requirement: Preferred USA B1 Business Visa with a minimum validity of 2 years