We are a Data Engineering Service that provides the collection, preprocessing, and storage of analytical data for data-driven decision-making, including the company’s products and process improvements via automation, all types of data analysis, and machine learning.
We are seeking a Middle Data Engineer to join our team. You will play a crucial role in managing TBs of data and integrating technologies such as Spark and Delta Lake. You`ll be engaged in the complete data preparation cycle — from collection to serving to our data users.
If you’re excited about data engineering and want to make an impact at MacPaw, we’d love to hear from you!
In this role, you will: * Develop and maintain data tools (Anomaly Detection System, ML platform, etc.) and data pipelines (Data Streaming Processors, ETL for third-party data sources) for other MacPaw teams according to functional and non-functional requirements, ensuring high quality (data reliability, efficiency, accessibility, etc.) * Analyze (how to do?) and validate (can be done?) technical solutions for business problems/ideas/needs. Suggest alternatives and ways for implementation with reasoning about their pros and cons * Decompose and estimate validated technical solutions for business problems/ideas/needs into technical tasks * Research and suggest architectural solutions and/or development tools to implement the technical task * React to issues and failures by investigating and fixing them according to service task priorities * Develop and maintain documentation, code, and business logic according to service requirements * Communicate with other teams to clarify requests and/or implementation details, edge cases, specify input or missing data and possible use cases/flows to successfully implement a solution and collaborate constructively
Skills you’ll need to bring: * Proficient in Python for data pipelines and advanced SQL (complex transformations, query optimization, window functions) * Experience building and optimizing large-scale data processing jobs with PySpark * Experience designing and building ETL/ELT workflows with Airflow * Experience with real-time data processing using message brokers like Kafka or RabbitMQ * Experience with data warehouses (BigQuery, Redshift), RDBMS (PostgreSQL preferred), and in-memory stores (Redis preferred) * Experience with a major cloud provider (GCP preferred), using services for storage, compute, and IAM * Experience with containerization using Docker (building images, managing containers) * At least an Intermediate level of English & fluent Ukrainian
As a plus: * Knowledge of dbt * Understanding of Open-table formats (Delta Lake, Apache Iceberg) * Knowledge of data lakehouse concepts * Experience building data APIs or services using backend frameworks (e.g., FastAPI, Django)
What We Offer: * We are a Ukrainian company, and we stand with Ukraine against the russian aggression We maintain workplaces for the mobilized Macpawians and provide financial support to colleagues or their families affected by the war. Here, you can also read about the MacPaw Foundation, which intends to help save the lives of Ukrainian defenders and provide relief to as many civilians as possible. * We are committed to our veterans Our Veteran Career and Empowerment Program is designed to ensure our veterans and active military personnel receive the recognition, support, and opportunities they deserve. * Hybrid work model Whether to work remotely or at the hub is entirely up to you. If you decide to mix it, our Kyiv office, which works as a coworking space, is open around the clock. The office is supplied with UPS and Starlink for an uninterrupted work process. * Your health always comes first We guarantee medical insurance starting on your first working month. For those abroad, you can receive a yearly Medical insurance allowance as compensation for managing your medical expenses. * Flexible working hours You can choose a schedule that is comfortable for you. No one here tracks your clock in/out because MacPaw is built on trust and cooperation. * Space to grow both professionally and personally Education opportunities to grow both hard and soft skills, annual development reviews, and internal community. * Teams we are proud of We build honest, transparent, and reliable relationships within teams. Every Macpawian can improve processes and implement their ideas. We encourage open and constructive feedback and provide training for Macpawians on giving and receiving feedback. * Office designed for people (and pets) Our office has it all: a spacious workplace with enough room for sitting up, lying down, and running around; a gym for recreation; cozy kitchens; a sleeping/meditation room; and a terrace with a view where we throw summer parties. Also, we have two cats living in the office, and you are welcome to bring your pets to the office (we have separate floors for cats and dogs). * Time-off policy that covers life’s needs Convenient personal time-off policy to help you take care of essential matters in your personal life, and parental leaves. On top of all that, sabbaticals are open after 5 years of being with MacPaw. * Join social initiatives with MacPawCares MacPaw participates in numerous humanitarian aid and charity projects across many fields, and you are welcome to jump in to make the world a better place. * We’re an equal-opportunity employer. Here is a safe place for applicants of all backgrounds We are hiring talented humans. Meaning with all our variety of backgrounds and identities, including service members and veterans, women, members of the LGBTQIA+ community, individuals with disabilities, and other often underrepresented groups. MacPaw does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. * ome benefits are under development, and new adjustments are possible.
