Responsible to optimize data structures and query performance to facilitate fast and accurate data retrieval.
Define tables, relationships, and optimize data structures for efficient query performance.
Write production-grade Python queries and work with ETL Tools e.g., Azure Data Factory, SSIS and write complex codes in database technologies (SQL etc.).
Create interactive and visually appealing dashboards using Tableau, enable stakeholders to gain actionable insights from complex datasets.
Translate complex data sets into insightful visualizations that drive data-informed decision-making.
Collaborate with cross-functional teams including Data Strategists, Data Scientists, and business stakeholders, act as a technical authority to provide guidance and mentorship to junior data engineers.
Communicate complex solutions in a clear and understandable way to both experts and non-experts and Play a crucial role in support, growth and development of the team.
Oversee data governance practices and ensure compliance with relevant regulations.
Establish data security protocols, access controls, and privacy measures, guarantee that data handling aligns with industry standards and legal requirements.
Implement data governance policies and procedures to ensure data privacy, security, and compliance with relevant regulations (e.g., GDPR).
Process large amounts of data using spark to ensure data are readily available for machine learning models, analytics, and business intelligence.
Implement and manage version control systems (e.g., Git) to track changes and maintain a history of code and configuration modifications.
Integrate source control with CI/CD pipelines to automate build, test, and deployment processes for data engineering artifacts, ensuring a streamlined and efficient development lifecycle.
Identify opportunities for performance enhancements and scalability improvements within the data infrastructure.
Proactively implement optimizations, such as query tuning, caching strategies, and data storage enhancements, to support efficient data processing and storage.
Take a lead role in troubleshooting data-related issues and incidents, diagnosing problems, and implement effective resolutions.
Expertise to mitigate risks, minimize downtime, and ensure the reliability and availability of data systems.
Education Required:
A Master’s Degree in Computers/IT/ Engineering / Math /Science/ Business or related field with 6 (six) months of Experience in the job offered closely related fields.
We also accept a Bachelor’s degree in Computers /IT/ Engineering/ Math/Science / Business or related field plus 3+ years of progressive work experience in a related field.
Experience Required:
Experience of 3+ Years is Preferred.
Travel and/ or relocation to unanticipated client sites throughout the USA is required.
Contact Us