Data Architect – Data Migration & Compliance
BiztechnosysJob Title: Data Architect – Data Migration & Compliance Platform Modernization
Location: Lakshimi Colony, T. Nagar, Chennai (This is work from office for 3 months initially
Duration: Long-term (C2H)
Role Summary:
We are seeking a highly experienced and hands-on Data Architect to lead and deliver the end-to-end data migration from Databricks and Teradata to BigQuery, including complete ETL/ELT pipeline design, dataset migration, and platform modernization. The candidate will also be responsible for understanding the existing audit compliance monitoring application and building a new data pipeline into the next-generation audit platform, ensuring high data quality, governance, and traceability.
Key Responsibilities:
Data Migration & Platform Delivery
• Lead and execute data migration strategy from Databricks and Teradata to Google BigQuery
• Analyze and migrate existing data models, views, datasets, and ETL pipelines
• Redesign schemas for optimized performance and compliance in BigQuery
• Identify and address data quality, format, lineage, and validation issues
Audit Compliance Application Transition
• Understand the current audit compliance monitoring application
• Identify data flows, lineage, metrics, alerts, and critical data sets used
• Redesign and build pipelines to feed data into the new audit compliance platform
• Ensure compliance with audit trails, data retention, and security policies
ETL/ELT Architecture
• Design and implement scalable and efficient ETL/ELT workflows using tools like Apache Airflow, dbt, Dataflow, or custom frameworks
• Ensure reusability, observability, and resilience of data pipelines
• Work closely with DevOps for CI/CD of data pipelines
Data Design & Governance
• Build logical and physical data models, define data contracts and standards
• Enable data quality rules, validation frameworks, and governance mechanisms
• Define partitioning, clustering, cost optimization strategies for BigQuery
Stakeholder Management & Leadership
• Collaborate with engineering, QA, product, data analysts, compliance, and audit teams
• Capture requirements, translate into technical designs, estimate workloads
• Lead and mentor a team of data engineers and assign responsibilities effectively
• Communicate status, risks, dependencies, and results to senior leadership
Required Skills & Experience:
Data Platforms:
• Deep hands-on expertise in BigQuery, Teradata, Databricks (Delta Lake, Spark)
• Good understanding of Google Cloud Platform (GCP) services: GCS, Pub/Sub, Dataflow, Composer
Tools & Frameworks:
• Proficiency in SQL, Python, and orchestration tools (Airflow, dbt, etc.)
• Experience with data pipeline frameworks, batch & streaming architectures
• Familiarity with audit logging, compliance monitoring, data security
Strategic & Functional:
• Strong data architecture, modeling (3NF, star, snowflake) and schema design experience
• Ability to reverse engineer data flows and audit systems
• Proven experience in data migration and modernization programs
• Experience working with audit, compliance, or risk applications is a strong plus
Communication & Leadership:
• Experience working with cross-functional teams in Agile/DevOps environment
• Excellent skills in requirement analysis, effort estimation, and task allocation
• Ability to lead technically while being hands-on in design and delivery
Preferred Qualifications:
• 10+ years in data engineering, data architecture, or BI
• Certifications in GCP (Professional Data Engineer or Architect)
• Background in audit, compliance, banking, or regulated environments
Deliverables Expected:
• Migration plan and roadmap for all datasets
• Target data models, dictionaries, and lineage documentation
• ETL/ELT pipeline code and documentation
• Data validation test scripts
• Migration success criteria and signoff reports
Soft Skills:
• Detail-oriented, organized, and analytical thinker
• Strong communication and presentation skills
• Proactive, adaptable, and thrives in a fast-moving environment