Skip to main content
Back to jobs

[Job - 29253] Senior Data Developer (AWS), Brazil

External
ciandt logoCiandt · Brazil
Full-timeRemote1mo ago30+ days old, may be filled
AirflowApacheAWSComplianceDocumentationPandas
Cover LetterConnect

Prepare for this interview

Elite

AI-generated questions, company research, and talking points tailored to this role

Responsibilities

  • Data Pipeline Development: Develop jobs in AWS Glue/Spark or Python (Pandas/Lambdas) for transforming raw data into curated datasets.
  • Data Storage Structuring: Structure data in Amazon S3 (Data Lake) and integrate it with Vector Databases or Redshift to support advanced analytics.
  • Data Processing: Handle both structured and unstructured data, ensuring it is processed into optimized formats (e.g., Parquet) for efficient querying and analysis.
  • Orchestration Configuration: Configure workflows using AWS Step Functions or Managed Workflows for Apache Airflow (MWAA) to automate data processing tasks.
  • Collaboration with Cross-functional Teams: Work closely with data scientists, engineers, and business stakeholders to understand data needs and deliver high-quality solutions.
  • Performance Monitoring: Monitor and analyze data pipeline performance, ensuring reliability and efficiency in data processing workflows.
  • Governance and Scalability: Implement data governance practices and scalable architectures to support corporate data initiatives.
  • AI Integration: Support the integration of AI capabilities into data workflows, enhancing the overall efficiency and effectiveness of our solutions.

Requirements

  • Advanced English proficiency (minimum) for interaction with global teams and documentation.
  • Strong experience with AWS ecosystem, particularly with S3 as the primary data source.
  • Proficiency in data processing frameworks such as AWS Glue, Spark, or Python (Pandas/Lambdas).
  • Experience with Databricks and Databricks Connector, including API integrations for data processing and structuring.
  • Expertise in handling structured and unstructured data, with knowledge of Vector Databases (e.g., Qdrant) for AI applications.
  • Proven ability to work in a hands-on capacity, transforming diverse files into processable datasets.
  • Familiarity with AI frameworks and methodologies.
  • Experience with data orchestration tools like Apache Airflow.
  • Knowledge of data governance and compliance standards.
  • Understanding of performance optimization techniques for data pipelines.
  • #LI-JP3

Benefits

-Health and dental insurance-Meal and food allowance-Childcare assistance-Extended paternity leave-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;-Profit Sharing and Results Participation (PLR);-Life insurance-Continuous learning platform (CI&T University);-Discount club-Free online platform dedicated to physical, mental, and overall well-being-Pregnancy and responsible parenting course-Partnerships with online learning platforms-Language learning platformAnd many more!More details about our benefits here: https://ciandt.com/br/pt-br/carreirasWe have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.

Additional Information

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 8,000 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. We are seeking a talented and motivated Data Developer to join our team. This role is pivotal in constructing scalable artificial intelligence solutions across various domains, including Commercial, Marketing, IT, and future areas of the company. The Data Developer will play a critical role in evolving isolated AI use cases into a unified ecosystem capable of integrating advanced AI capabilities. The successful candidate will contribute to building the technical foundation of our platform, enabling independent evolution, integration with multiple data sources, and accelerating new AI capabilities within the company. This position demands a blend of technical expertise, strategic thinking, and a hands-on approach to data development.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at ciandt? Share your experience

Interested in this role?

Apply on the company's website.

Cover LetterConnect