Senior Data Engineer

The Senior Data Engineer will design, build, and maintain robust, scalable, and secure data pipelines and platform that enable Transport for Wales'(TfW) to make data-driven decisions.

Role responsibilities

• Drive the provision of a resilient and future-ready data platform that underpins organisational growth, supports cross-functional analytics, and enables data-driven decision-making by developing and deploying scalable data pipelines leveraging a Microsoft Azure-first approach, utilising tools such as Fabric, Data Factory, Databricks, and Synapse Analytics to ensure workflows are modular, testable, and well-governed
• Implement robust data management practices focused on data domains, quality, and lineage by integrating data from multiple internal and external sources into a cohesive system to ensure that data is comprehensive, accurate, and traceable, supporting reliable business analysis and reporting.
• Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource-efficient data processing, meeting the organisation's evolving analytical and operational demands.
• Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processes, empowering stakeholders to make informed decisions based on high-quality, processed information.
• Safeguard organisational data by developing and enforcing data engineering and enterprise cloud standards, creating comprehensive guidelines and frameworks to ensure all solutions adhere to security, privacy, and compliance regulations such as GDPR.
• Work closely with data analysts, architects, DevOps, and business stakeholders through regular communication and collaborative planning to ensure data solutions are closely aligned with business objectives and effectively meet user needs.
• Continuously monitor and optimise the performance of data systems by tracking system health, resolving issues, and enhancing availability to guarantee uninterrupted data access and maintains high operational standards across the organisation.
• Contribute to the development and execution of the Data Strategy by maintaining thorough documentation of data processes, architectures, and workflows to ensure all technical and process information is systematically recorded, updated and data initiatives deliver business value and are aligned with broader technology and organisational goals.

Who we're looking for

• Degree or MSc in Computer/Data Science or Data Engineering or equivalent experience in data engineering, data management, or a related field.
• Proven experience in designing, building, and maintaining data pipelines using tools such as Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles.
• Experience of using programming languages such as Python, Scala and SQL and of data transformation, testing, and automation.
• Demonstrable knowledge of data modelling (star/snowflake schemas, dimensional models) and data warehousing within platforms such as Azure Synapse Analytics.
• Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud-based architectures.
• Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery.
• Robust understanding of data governance, data quality, and metadata management, aligned to DDaT and UK Government Data Standards.
• Demonstrable experience of analysing complex data sets and deriving actionable insights.
• Experience of communicating technical information and data to a non technical audience and working collaboratively with analysts, architects, and product owners to deliver data solutions that meet user and organisational needs.

Welsh Language Skills

While not essential for this role, Welsh language skills would make a great addition to your application.

TfW support anyone who wants to learn Welsh or improve their skills. We offer online learning, classroom courses and funding attendance at local community courses.

Equal Opportunities

We're changing the way the transport industry looks. By celebrating and embracing differences, we're building a workforce that represents Wales. We need talented people from all backgrounds and cultures to bring their perspectives and experiences. Diverse teams make better decisions and drive innovation. Join us in transforming the way Wales travels."

Who we are 

Transport for Wales is changing the way Wales travels, making sustainable transport the first choice. We're building a multimodal integrated transport network called the T Network, making it easier for people to travel by train, bus, walking, wheeling and cycling.

Y Swydd

Bydd y Peiriannydd Data Arweiniol yn dylunio, yn creu ac yn cynnal llwyfan a phiblinellau data cadarn, graddadwy a diogel sy'n galluogi Trafnidiaeth Cymru (TrC) i wneud penderfyniadau sy'n seiliedig ar ddata.

Cyfrifoldebau'r swydd

• Sbarduno'r gwaith o ddarparu llwyfan data cadarn sy'n barod ar gyfer y dyfodol drwy ddatblygu a defnyddio piblinellau data graddadwy gan ddefnyddio dull Microsoft Azure, defnyddio offer fel Fabric, Data Factory, Databricks, a Synapse Analytics i sicrhau bod llifoedd gwaith yn fodiwlaidd, yn brofadwy ac yn cael eu llywodraethu'n dda. Mae hyn yn sail i dwf sefydliadol, yn cefnogi dadansoddeg draws-swyddogaethol, ac yn galluogi'r broses o wneud penderfyniadau yn seiliedig ar ddata.
• Gweithredu arferion rheoli data cadarn sy'n canolbwyntio ar barthau data, ansawdd a llinach drwy integreiddio data o nifer o ffynonellau mewnol ac allanol i system gydlynol i sicrhau bod data'n gynhwysfawr, yn gywir ac yn hawdd ei olrhain, gan gefnogi dadansoddiadau ac adroddiadau'r busnes.
• Dylunio, gweithredu ac optimeiddio modelau data ffisegol sy'n cyd-fynd â saernïaeth piblinell, trwy ddefnyddio'r dull sy'n sicrhau perfformiad ymholiadau effeithlon, storfa raddadwy, a dull integreiddio cadarn ac sy'n darparu prosesu data addasadwy ac effeithlon o ran adnoddau, i ddiwallu gofynion dadansoddol a gweithredol esblygol y sefydliad.
• Trawsnewid data crai yn wybodaeth ystyrlon drwy ddatblygu a chynnal prosesau ETL (Echdynnu, Trawsnewid, Llwytho) wedi'u teilwra sy'n galluogi prosesau wedi'u haddasu, gan rymuso rhanddeiliaid i wneud penderfyniadau gwybodus yn seiliedig ar wybodaeth prosesedig o ansawdd uchel.
• Diogelu data sefydliadol drwy ddatblygu a gorfodi safonau cwmwl menter a pheirianneg data, gan greu canllawiau a fframweithiau cynhwysfawr i sicrhau bod yr holl ddatrysiadau yn glynu wrth reoliadau diogelwch, preifatrwydd a chydymffurfio, fel GDPR.
• Gweithio'n agos gyda dadansoddwyr data, penseiri, DevOps a rhanddeiliaid busnes drwy gyfathrebu'n rheolaidd a chynllunio ar y cyd i sicrhau bod datrysiadau data yn cyd-fynd yn agos ag amcanion busnes ac yn diwallu anghenion defnyddwyr yn effeithiol.
• Monitro ac optimeiddio perfformiad systemau data yn barhaus drwy olrhain iechyd y system, datrys problemau, a gwella argaeledd i warantu mynediad di-dor at ddata a chynnal safonau gweithredu uchel ar draws y sefydliad
• Cyfrannu at ddatblygu a gweithredu'r Strategaeth Data drwy gynnal dogfennau trylwyr o brosesau, saernïaethau a llifoedd gwaith data i sicrhau bod yr holl wybodaeth dechnegol a phrosesu yn cael ei chofnodi, ei diweddaru a bod mentrau data yn darparu gwerth busnes ac yn cyd-fynd â nodau technoleg a sefydliadol ehangach.

Am beth rydyn ni'n chwilio

• Gradd neu MSc mewn Cyfrifiadureg/Gwyddor Data neu Beirianneg Data, neu brofiad cyfatebol mewn peirianneg data, rheoli data, neu faes cysylltiedig.
• Profiad amlwg o ddylunio, creu a chynnal piblinellau data gan ddefnyddio offer fel Azure Data Factory, Databricks, neu Apache Spark, gan ddilyn egwyddorion ETL/ELT modern.
• Profiad o ddefnyddio ieithoedd rhaglennu, fel Python, Scala ac SOL ac o drawsnewid, profi ac awtomeiddio data.
• Gwybodaeth amlwg am fodelu data (sgemâu seren/pluen eira, modelau dimensiynol) a storio data ar lwyfannau fel Azure Synapse Analytics.
• Profiad ymarferol gyda gwasanaethau Microsoft Azure, gan gynnwys Azure Data Lake (Gen2), Synapse, Event Hubs, a Cosmos DB, mewn saernïaethau graddadwy yn y cwmwl.
• Profiad o ddefnyddio Git, Azure DevOps, neu GitHub Actions ar gyfer rheoli fersiynau, CI/CD, a darparu data cydweithredol.
• Dealltwriaeth gadarn o lywodraethu data, ansawdd data, a rheoli metaddata, sy'n cyd-fynd â DDaT a Safonau Data Llywodraeth y DU.
• Profiad amlwg o ddadansoddi setiau data cymhleth a chael dealltwriaeth y gellir gweithredu arni.
• Profiad o gyfleu gwybodaeth a data technegol i gynulleidfa annhechnegol, ac o weithio ar y cyd â dadansoddwyr, penseiri a pherchnogion cynnyrch i ddarparu datrysiadau data sy'n diwallu anghenion defnyddwyr a sefydliadau

Sgiliau Cymraeg

Er nad yw sgiliau Cymraeg yn hanfodol ar gyfer y swydd hon, byddent yn ychwanegiad gwych at eich cais.

Mae TrC yn cefnogi unrhyw un sydd eisiau dysgu Cymraeg neu wella ei sgiliau. Rydyn ni'n cynnig cyfleoedd dysgu ar-lein, cyrsiau ystafell ddosbarth, a chyllid i fynd ar gyrsiau yn y gymuned leol.

Cyfle Cyfartal

Rydyn ni'n newid y ffordd y mae'r diwydiant trafnidiaeth yn edrych. Drwy ddathlu a chroesawu gwahaniaethau, rydyn ni'n datblygu gweithlu sy'n cynrychioli Cymru. Mae angen i ni gael pobl ddawnus o bob cefndir a diwylliant i ddod i rannu eu safbwyntiau a'u profiadau. Mae timau amrywiol yn gwneud penderfyniadau gwell ac yn sbarduno arloesedd. Ymunwch â ni i drawsnewid y ffordd y mae Cymru'n teithio."

Pwy ydyn ni 

Mae Trafnidiaeth Cymru yn newid y ffordd y mae Cymru'n teithio, gan sicrhau mai trafnidiaeth gynaliadwy yw'r dewis cyntaf. Rydyn ni'n datblygu rhwydwaith trafnidiaeth integredig aml-ddull o'r enw Rhwydwaith T, i'w gwneud hi'n haws i bobl deithio ar y trên, ar y bws, ar droed, ar olwynion ac ar feic.