Atenção! Esta oferta já expirou, não sendo possível efectuar mais candidaturas. Emprego Big Data Engineer (M/F) Empresa:Landing.Jobs Data Publicação:19/09/2019 Descrição da Função:Daltix is a fast-growing, successful, data-driven start-up from Belgium with offices in Boom, Ghent and Lisbon. We are bringing real-time insights to the world of retail. How we are doing that? We have developed a set of tools to gather, process and analyze retail data and to bring this all together in our data platform we offer to our clients. So far, we have had great success in doing so. That’s why today Daltix serves customers such as Makro, Lidl, Dreamland, Jumbo, Greenyard,, Unilever and others.Sign me up! No wait... What will I be doing?We are looking for a kickass Big Data Engineer who is excited to help join our data engineering team in Lisbon. Together, you will extend and maintain the various data pipelines that are at the heart of our business. We are a data-driven company which collects and processes more than 600GB of raw data daily. We leverage big data technologies such as Spark/Dask on AWS EMR to crunch these volumes of data and make it queryable. In this role you will ensure uptime, quality, and build upon our mission-critical Spark/Dask and Python frameworks that turns the HTML of millions of retail web pages into structured JSON, CSV & ORC formats.In order to do this, you’ll need to jump head first into this state of the art data lake designed and implemented by Belgium’s top data engineering firm DataMinded. Your typical tasks:Data Warehouse expansion & maintenance.Required skills: Python, Spark/Dask, SQL, AWS (EMR, Lambda, Elastic Search, Athena, …) , Apache Airflow.Infrastructure setup for data processing pipelines.Required skills: EMR, Spark/Dask, Airflow, Automation, Docker, …Design and build big data processing architectures to build further use-cases (such as AI and machine learning) upon our data.Required skills: AWS solutions/architecture design, Python, cost-awareness.Data Mart/Warehouse design to make our data more accessible for BI tools, marketing and analytics.Required skills: SQL database/data warehouse design, Python, data modelingWhy you're the one, we are dying to meet:You have at least 3 years of relevant experience & exposure to Python programmingYou have a background in computer engineering (or relevant computer engineering degree)You have experience building on top of Amazon Web ServicesYou have a good understanding of databases/data warehouses/data lakesYou have experience with big data technologies (such as ElasticSearch, Spark, Hadoop, Airflow, Cassandra)You are fluent in English (written and spoken)You have excellent problem-solving capabilities and a critical mindsetYou are based in Lisbon (Portugal) or willing to relocateNice to have:You are passionate about data engineeringYou are passionate about software engineeringYou get energy from working in a highly complex and challenging startup environment with a high tech product Oferece-se:If you still need more convincing…We are a young, entrepreneurial and fast-growing company; you will have the unique opportunity to shape our future and have a positive impact on our clients’ businessYou will be offered a competitive wage in a talented, international team of top-notch expertsFlexible work arrangements with a lot of autonomy in what you do and where you do it, and home office - We trust you to know your schedule and work when you feel most productiveYou will be able to participate in relevant trainings to stay at the top of this field. Be part of an interesting and dynamic start-up and enjoy the scaling process.An open company culture where we play as hard as we workA cosy office in the heart of LisbonHealth Insurance coverageFresh fruit, snacks, tea and coffee on the houseOccasional drinks and team eventsYou’ll get the chance to meet and work with industry professionals and help lift the company to the next levelLocal:Lisboa (Distrito de Lisboa) Partilhar esta informação Enviar a oferta: Big Data Engineer (M/F) Comentários Atenção! Esta oferta já expirou, não sendo possível efectuar mais candidaturas. Candidate-se a esta oferta Será redireccionado para o site da empresa