Lucid is the world’s largest audience platform for sourcing and understanding real, deterministic data about human behavior at scale. The company has built the largest and most powerful programmatic survey exchange, and has enabled brands, agencies and partners to ask and answer more than 8 billion questions worldwide. With a pool of over 70 million respondents, Lucid delivers unprecedented access to consumers for data-driven decision making – about everything from marketing to product development in real-time. Lucid is headquartered in New Orleans with offices in London and Gurgaon.
The Opportunity
The Senior Data Engineer will join our Engineering team in New Orleans, and work closely with our Business Intelligence and Corporate Business Operations teams. Do you have extensive experience designing schemas, report generation and turning data in to business value? Do you know SQL inside and out? Are you looking to expand your skill set to include Cassandra, Amazon Redshift, Apache Kafka, Apache Spark, and any other helpful tool you may discover? This is the opportunity you’ve been looking for.
Want more jobs like this?
Get Software Engineer jobs delivered to your inbox every week.
Responsibilities
- Collaborate with business units to translate challenges and opportunities into data warehousing/ETL and Stream Processing projects
- Analyze source systems including internal systems and API integrations
- Design and implement ETL systems to source data into Data Warehouse and OLAP DBs
- Perform SQL query performance tuning
- Aid in creation of dimensionally modeled data warehouse
- Maintain, update, and create new SSIS packages
- Build out self-service BI applications including Power BI
- Create and maintain reporting environment to support client-facing reports embedded in custom applications
Qualifications
- 3+ years of experience in development with a focus on ETL and data warehousing
- Strong knowledge of dimensional data modeling/star schema
- Strong knowledge of SQL including the ability to analyze execution plan for performance tuning
- Ability to identify and implement new tools as projects dictate
- Experience creating views and stored procedures for supporting various reporting applications
- Experience with source control systems including Github
- Continual learner, always looking for a new and better way to solve a problem
Preferred Qualifications
- AWS experience with Redshift, EMR, and Elasticsearch
- Experience with NoSQL data sources including Cassandra
- Experience with SQL Server 2014, In-Memory tables, DAX, MDX and Power BI
- Experience with Apache Spark
- Experience creating Data Lakes
At Lucid we foster a collaborative and inspiring workplace. We pride ourselves in doing this by recruiting, hiring and retaining diverse, passionate, and forward-thinking talent. Lucid is committed to and encourages an inclusive environment and we are dedicated to providing equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.