Big Data Engineer (with Palantir Foundry) @ N-iX
N-iX
Nice to have:
We are looking for a proactive Middle+/Senior Big Data Engineer to join our vibrant team! You will play a critical role in designing, developing, and maintaining sophisticated data pipelines, and using Foundry tools such as Ontology, Pipeline Builder, Code Repositories, etc. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.Tools and skills you will use in this role: Palantir Foundry, Python, PySpark, SQL, basic TypeScript. ,[Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows., Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development., Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information., Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency., Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes., Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes., Be eager to get familiar with new tools and technologies] Requirements: Palantir, Python, PySpark, SQL, Cloud platform, Docker, Kubernetes, TypeScript Tools: Agile, Scrum. Additionally: Flexible working hours and remote work possibility, Mentoring program, Life insurance, Training budget, English lessons, Compensation of Certifications, Active tech community, International team, Referral program, Cafeteria, Modern office, Free coffee, Kitchen, Friendly atmosphere.
Polska
Tue, 23 Jul 2024 22:02:30 GMT
To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesineu.com) you saw this job posting.
Location: London City and West End, London, United Kingdom Salary: £45500 per annum Benefits: £45,500…
Job title: Deputy Headteacher/Head of Education Company: Outcomes First Group Job description Full Job DescriptionAt…
Job title: Infermiere per riabilitazione psichiatrica residenziale diurna e domiciliare Company: Randstad Job description Randstad…
Job title: Project Manager Infraestructura IT - remoto, 100% En remoto Company: Second Window Job…
Job title: Group, conference & events Manager - Renaissance Brussels Hotel Company: Marriott Job description…
Job title: Senior Content and Communications Specialist Company: Penneo Job description Who are we?We are…