Data Engineer
Lexer
About the role
Senior Data Systems Engineers are responsible for building Lexer's systems to process and analyse large volumes of incoming customer data at scale. They make customer data available for analysis, segmentation, and integration with other platforms.
They are experts in Spark, Python, Big Data Engineering, Data Lakes, Streaming data processing pipelines, Workflow engines, and APIs.
Data Systems Engineers are critical for keeping data flowing into the Lexer product and making it easy for our customers to make productive use of all this data. They collaborate closely with the Data Science, Product Management, and Data Operations teams and other developers in the Product team.
In this role, you will,
- Software engineering - write code, add new features, perform maintenance, fix bugs, write tests, perform code reviews, deploy code into production, and produce technical documentation.
- Team Assistance and Mentoring - pair with other developers, help others solve problems, teach others how the system works, discuss improvements in technology and processes, and work with the Product Management team to scope changes and ship projects.
- System analysis and design - produce the detailed design of new features, analyse the existing system to establish the impact of changes, identify areas of improvement within the system, perform task breakdowns and estimations, and evaluate new technologies.
- Support - be an advocate for the Product, quickly respond to bugs or issues, clearly communicate with the support team, be the subject matter expert on the system to help other teams work with it, and participate in the regular dev first responder roster.
For This Role, You Will Have:
- A love for Spark, you will need strong coding skills, in particular, back-end Python programming
- A good understanding of how data is managed in a big data system, i.e. data lakes, data catalogs, how and when to use different file formats (e.g. Parquet, etc.)
- Relational database experience, from writing analytical queries in SQL to designing database schemas.
- Modern software engineering practices, including automated testing, continuous delivery, and structured logging.
- Experience building public-facing APIs, including API versioning, authentication, rate limiting, Open API specifications, and designing APIs for scale
- Experience working with queuing systems, such as SQS, to process large volumes of data.
- Experience working with streaming data processing systems such as Kinesis or Kafka and or experience with orchestrating data processing pipelines using workflow engines such as Airflow.
- An interest in Machine Learning and how to incorporate it into a big data system.
What Are the Perks?
- 4 weeks annual leave, plus gifted leave between Christmas and New Year.
- Hybrid policy (3 days in office). Dog-friendly office
- Many many cultural events—daily trivia, weekly tastings, homemade Friday lunches, cinema nights, book club, yoga, and more
About Lexer
Lexer helps brands and retailers drive incremental sales.
We do this by providing data, software, and services that deliver an enriched customer view and all the tools required to genuinely understand and engage with customers at every stage of their journey, online and offline. With extensive, cross-functional experience in retail, technology, and advertising, our team has the talent and insight to build innovative products and provide exceptional service with a human touch.
We value team members who are:
🤓 Sharp 👯♀️ Dependable 💪 Proactive 📈 High-value ❤️ Caring 👩🎤 Playful
We are a private Australian-founded company with a team of 90+ across Melbourne, Sydney, Vietnam, Singapore and the USA working with about 200+ brands in Australia, Asia, and the USA.
We're growing fast, so reach out soon to join our values-driven, life-friendly team for the opportunity to do your best work.
Lexer is an equal-opportunity employer
At Lexer, we believe in bringing your whole self to work. We don't just accept difference, we love and celebrate it. We make hiring and employment-related decisions based on a person's experience, qualifications, performance, and passion.
We celebrate all cultures, linguistic backgrounds, abilities, races, genders, sexual orientations, as well as family and carer responsibilities. We do not discriminate against any candidate or employee for these reasons or for any other reason protected by law.
Some roles are subject to a background and criminal history check, where this is a security requirement. Any information we collect about you is subject to Lexer's Privacy Policy https://lexer.io/privacy-policy/
We encourage all applicants to apply, including those seeking flexible working options. We will consider requests for flexible work options wherever reasonably possible.