Big Data Engineer

What You'll Do7

• Architect and sustain scalable big data pipelines and storage solutions.
• Partner with product and engineering teams to translate data needs into technical deliverables.
• Build data integration, transformation, and processing workflows using Python and big data tools.
• Set up and tune distributed databases and storage systems for reliability and speed.
• Watch over data systems, resolve issues, and improve performance to maintain high uptime.
• Apply data quality, security, and governance rules across all data solutions.
• Write clear documentation and explain technical concepts to both technical and non-technical audiences.

Requirements7

• Hands-on experience building and maintaining large-scale data pipelines in a big data engineering role.
• Strong Python skills for data processing, automation, and integration tasks.
• Solid grasp of relational and NoSQL databases, including optimization and management.
• Familiarity with distributed processing frameworks such as Hadoop, Spark, or Flink.
• Knowledge of data modeling, ETL processes, and data warehousing principles.
• Ability to communicate technical ideas clearly in writing and speech to varied stakeholders.
• Self-motivated and detail-oriented, with a track record of working well remotely and independently.

Who Should Apply

This role suits engineers with proven big data pipeline experience and advanced Python skills, especially those who have worked with distributed frameworks like Spark or Flink. Candidates who have supported global teams in startup-like settings and are comfortable with cloud platforms such as AWS, GCP, or Azure will stand out. It is less ideal for someone who needs close supervision or prefers a fixed office setting. A common reason candidates get rejected is lacking hands-on experience with large-scale data pipelines or failing to show clear communication skills in a remote context. Another pitfall is not demonstrating familiarity with both relational and NoSQL databases in past projects.

Salary Insight