Data Engineer - Databricks specialist
Today• Vilnius, Lithuania
Introduction
Are you passionate about building scalable data solutions and working with cutting-edge technologies? We're looking for a Data Engineer with deep expertise in Databricks to help us design and optimize modern data processing frameworks.
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your role and responsibilities
- Design and build streaming & batch data pipelines using Apache Spark on Databricks
- Optimize performance with Delta Lake, Z-ordering, and liquid clustering
- Work hands-on with PySpark, SQL, and develop our modern Data Lakehouse architecture
- Leverage the latest Databricks features: Structured Streaming, Lakeflow, Unity Catalog, DBSQL
- Support AI/ML workflows and implement CI/CD pipelines with tools like GitHub Actions or Azure DevOps
Want more jobs like this?
Get jobs in Vilnius, Lithuania delivered to your inbox every week.
Required education
Bachelor's Degree
Preferred education
Master's Degree
Required technical and professional expertise
- 3+ years in data/software engineering with large-scale distributed systems.
- Strong Python skills (OOP, pytest/unittest) and good experience with PySpark, SQLGlot, Pydantic
- Solid understanding of medallion architecture, data ingestion, and big data optimization
- Familiarity with Git workflows and platforms like GitHub, GitLab, or Azure DevOps
- Experience with cloud platforms (Azure preferred) and Databricks.
Preferred technical and professional experience
- Certifications in Databricks or Azure Data Engineering
- Experience with real-time data processing (e.g., Kafka, Spark Streaming)
- Exposure to AI/ML workflows and tools like MLflow.
ABOUT BUSINESS UNIT
IBM Consulting is IBM's consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients' businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.
YOUR LIFE @ IBM
In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.
Being an IBMer means you'll be able to learn and develop yourself and your career, you'll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.
Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.
Are you ready to be an IBMer?
ABOUT IBM
IBM's greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.
Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we're also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.
At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it's time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.
IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
OTHER RELEVANT JOB DETAILS
IBM wants you to bring your whole self to work and for you this might mean the ability to work flexibly. If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment.
Client-provided location(s): Vilnius, Lithuania
Job ID: IBM-64284
Employment Type: OTHER
Posted: 2025-10-14T18:48:42
Perks and Benefits
Health and Wellness
Parental Benefits
Work Flexibility
Office Life and Perks
Vacation and Time Off
Financial and Retirement
Professional Development
Diversity and Inclusion
Company Videos
Hear directly from employees about what it is like to work at IBM.