Data Engineer (Web Scraping & Data Ingestion)

Requirements

• You care deeply about:
• Building resilient, observable, and scalable data systems
• Writing clean, maintainable code
• Data correctness and pipeline reliability
• Collaborating across engineering, product, and intelligence teams
• You are comfortable working primarily in Python, have experience with cloud infrastructure (AWS), and are eager to continuously improve both systems and processes.
• What you get to every day:
• Lead and own social media web scraping and data ingestion pipelines sourcing data from open-source datasets and social media platforms
• Design, build, and maintain scalable ETL and data processing pipelines (batch and/or streaming)
• Optimize existing scraping infrastructure for performance, reliability, and cost
• Handle challenges such as anti-bot protections, rate limiting, schema changes, and data quality issues
• Build and maintain ingestion pipelines that feed downstream systems such as Elasticsearch and other data stores
• Collaborate closely with product, intelligence, and platform teams to ensure data meets customer and business needs
• Operate in an Agile environment using tools like Git, JIRA, Jenkins, and Slack
• Contribute ideas and improvements that advance AlertMedia's technical leadership in data-driven threat and risk intelligence
• Help shape best practices around monitoring, alerting, testing, and documentation for data pipelines
• Contribute to AlertMedia's culture, values, and long-term technical vision
• What you bring to the role:
• Bachelor's degree in Computer Science, Engineering, or a related technical field (preferred)
• 3-4+ years of demonstrated experience in data engineering or backend engineering roles
• Hands-on experience with social media web scraping in production, including large-scale or high-reliability systems
• Strong proficiency in Python for data ingestion, scraping, and pipeline development
• Experience with AWS or other cloud platforms (required)
• Solid understanding of databases and data storage systems (Postgres, Redis, or similar)
• Experience building and operating ETL pipelines, including data validation and transformation
• Experience with stream processing and/or event-driven architectures (Kafka, Kinesis, SQS, etc.) is a strong plus
• Experience working with Elasticsearch or similar search/data indexing systems (nice to have)
• Strong organizational skills and ability to manage multiple pipelines and priorities
• Excellent written and verbal communication skills, with the ability to collaborate cross-functionally
• Ability and desire to work in a fast-paced, technically challenging environment
• English proficiency (written and oral) is required
• Why you'll love working at AlertMedia:
• Competitive Base Salary
• Annual Company Bonus
• 100% Employer-Paid Medical, Dental, and Vision Coverage
• Parental Leave Program
• Christmas Bonus (Aguinaldo)
• Generous Vacation and Holiday Policy
• Additional Vacation Bonus
• Monthly Work-from-Home Stipend
• All Necessary Equipment Provided: Laptop, monitor and accessories
• Recognition & Rewards: We celebrate wins big and small
• Languag

Benefits

Additional Information

Do work that matters. At AlertMedia, everything we do supports our mission: To save lives and minimize loss by identifying active threats globally and facilitating timely communications when an emergency threatens personal safety and business continuity. Our core values drive us in our important mission of keeping people safe & informed: We're humans not robots Customers always come first We work better together Simplicity is our strength Our reputation is priceless Hard work pays off As one of the fastest growing software companies in the nation, we're focused on finding the best talent and building the best team to continue accelerating our rapid growth to keep up with our demand. AlertMedia is looking for an experienced Data Engineer with a strong background in social media web scraping, data ingestion, and large-scale data pipelines. This role is a hands-on opportunity to lead the design, maintenance, optimization, and expansion of pipelines that ingest data from open-source data sources and social media platforms at scale. You'll play a critical role in how AlertMedia discovers, processes, and delivers real-time signals to customers. We're looking for someone with demonstrated experience in production-grade scraping and data engineering, who is comfortable owning complex systems end to end and improving them over time. We want you to shine by showing us real work you're proud of - systems you've built, pipelines you've scaled, and hard problems you've solved. We don't do trick questions or whiteboard exercises.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at alertmedia? Share your experience