Lead Software Engineer

Work from Home Lead Data Software Engineer

Agile
Engine is a
- ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the
- growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment daily, there’s no better place — guaranteed! :)

What you will do

• Collaborate closely with Data Scientists to understand their data requirements, model development needs, and performance optimization goals;
• Design, build, and maintain scalable data pipelines and infrastructure to support ML model development and deployment;
• Collect, process, and prepare large datasets for analysis, feature engineering, and model training;
• Implement data quality checks, validation, and monitoring to ensure the reliability and accuracy of data used in ML models;
• Optimize data storage, retrieval, and processing performance for ML workloads;
• Develop and maintain ETL (Extract, Transform, Load) processes and workflows;
• Manage data versioning, storage, and access control for ML datasets;
• Collaborate with Dev
  Ops and IT teams to ensure smooth deployment and scaling of ML models in production environments;
• Stay
  -
  - date with emerging technologies, tools, and best practices in data engineering and ML infrastructure.

Must haves

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field;
• Proven experience as a Data Engineer, preferably in a role supporting Data Scientists;
• Strong proficiency in programming languages such as Python, Java, or Scala;
• Proficiency with data storage and processing technologies, including SQL databases, No
  SQL databases, and distributed computing frameworks (e. g. , Hadoop, Spark);
• Experience with data warehousing solutions and data integration tools;
• Experience with data pipeline and workflow management tools: AWS glue, Airflow, etc;
• Knowledge of ML frameworks (e. g. , Tensor
  Flow, Py
  Torch) and ML model deployment;
• Familiarity with cloud platforms (e. g. , AWS, Azure, Google Cloud) and containerization (e. g. , Docker, Kubernetes);
• Excellent
  - solving skills and a collaborative mindset;
• Excellent oral and written communication skills with a keen sense of customer service.

Nice to haves

• Experience in ad/marketing environment;
• Experience working with Data Lakes;
• Experience with Scala;
• Experience with Glue/EMR/Redshift/Airflow;
• Experience with Terraform.

The benefits of joining us

• Professional growth – Accelerate your professional journey with mentorship, Tech
  Talks, and personalized growth roadmaps.
• Competitive compensation – We match your
  - growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects – Join projects with modern solutions development and
  - tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime – Tailor your schedule for an optimal
  - life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.