Fail Fast, Learn Faster...

Get In Touch

About Me

about

Hi,

I'm Shaun, An experienced Engineer with a technical scope including but not limited to, Data Engineering, Automation, DevOps and Cloud Infrastructure. I have over 10 years technical experience working on various projects within various facets of Information Technology. I'm always looking for new technical challenges and opportunities to learn new things...

Loves!!!
Currently in love with all things Golang \( ^_^)/

Interests
Learning everying I can about & coding as much as possible using Rust <( *_* )>

Pondering
Ways to enhance micro-services & multi-language projects/environments using gRPC
<{ o_O }/

Download CV Get In Touch

Experience

December 2022 - Present
Coralogix
Coralogix - Customer DevOps Engineer

Develop tailored data collection solutions for metrics, logs & traces by leveraging various Open Source projects and ensure efficient integration between Coralogix and client platforms.

AWS (EKS, ECS, Lambda, Cloudformation), Prometheus, Kubernetes, Open Telemetry, Fluentd, Fluentbit and more.

  • Collaborate with Coralogix clients to engineer bespoke data collection engines and pipelines that focus on logs, metrics, and application traces.

  • Streamline integrations between Coralogix and client platforms, ensuring optimal data flow and interaction.

  • Proactively research, innovate and build tailored solutions to facilitate integration in scenarios where standard methods are insufficient or unavailable.

  • Specialize in the analysis and diagnosis of complex platform and integration issues.

  • Instrument various applications for traces and metrics. Go, Python, NodeJS.

July 2019 - Present
Daidokoro
Director, Contractor & Engineer

I research, prototype, develop and deliver technical solutions utilising modern technology and innovative techniques. These engagements are normally as a Contractor, Consultant or Freelance Engineer.

Reliably

Software/Data Engineer (Golang)

Worked with Reliably to build a platform to enhance systems and software reliability, facilitate the creation of meaningful Service Level Objectives (SLOs) and gain insight into overall platform stability.

  • Code various Micro Services in Go as part of the overall Reliably Infrastructure:
    (GKE, Cloudrun, Cloudfunctions, Datastore, CloudSQL and more...)

  • Implement CI/CD pipelines for various micro services via Github Actions

  • Utilise Terraform to automate the deployment of Google Cloud infrastructure

  • Use log-based metrics to create visibility of application and infrastructure usage via BigQuery and Data Studio

Barclays UK via ECS Digital

DevOps Engineer/Consultant

Worked with one of the largest Banks in world consulting on and architecting various elements of Serverless and Container Security on AWS.

  • Architected initial design for implementing Container Security in AWS using chosen vendor solutions

  • Evaluated 3rd Party solutions for Serverless Security, assessing capabilities and suitability for the environment

  • Implemented Container Security Software solution in AWS using Cloudformation, Jenkins, Git & Chef

  • Coded custom lambda resources to enhance 3rd party solution functionality and fascilitate better integration

  • Consulted on Serverless Security approaches, barriers and foundational core concepts.

Shipa

Freelance Contract

A Container Based Platform as a Service (PaaS) Offering.

  • Refactored thousands of lines of code and repurposed Open Source solutions while creating new functionality and features

  • Implement CI/CD via Travis CI

  • Create and Update Automated Unit and Integration Tests

  • Orchestrate Docker Containers at a code level, utilising the Docker Golang library

  • Devise multi cloud authentication solution for allowing Shipa to orchestrate nodes on Azure, AWS & Google Cloud.

Entura International

Contract - Software Engineer

Develop a solution for monitoring the BitTorrent Network and Sending emails to infringing entities.

  • Design and implement code and infrastructure for monitoring torrent network and sending emails - Golang, AWS SES, Containers(Kubernetes), Google Storage and PubSub

  • Create automated Integration and Unit tests

  • Create CI/CD pipeline using Gitlab CI

  • Create Documentation

Happy Health You

Freelance Contract - Data Engineer

Data Engineering Project to extract, transform, structure and visualise data collected through hundreds of thousands of surveys.

  • Analyze existing data stored in Google Cloud SQL (MySQL) and create an ETL (Extract, Transform & Load) process for offloading

  • Consult on the best and most cost effective storage solution for data exploration given the scale of the project (BigQuery)

  • Create BigQuery onboarding ETL process

  • Analyze data in BigQuery and create subsets and views for in-depth analysis

  • Utilise Google Data Studio to create Dashboards and Visualisations

July 2017 - July 2019
Nahuru
Nahuru - Head Of Engineering

Building one of the most advanced platforms on the planet for recording, tracking and reporting on P2P download data worldwide.

AWS, Google Cloud, BigData, Machine Learning, Data & Software Engineering and more.....

Miru - Global Torrent Data Collection Engine

  • Design and implement a serverless solution on AWS for tracking and reporting on P2P torrent data worldwide.

  • Creating a scalable collection engine for collecting torrent data (Golang) using AWS Lambda.

  • Developing Data Engineering Pipelines for BigData ETL Jobs utilising Apache Beam, EMR (Presto, Hive, Hadoop), Kinesis, Firehose & S3, Google PubSub.

  • Utilising Kubernetes and containers for custom web scrapers for data collection.

Sauto (Search Automation) - Automation platform for torrent hash collection

  • Create and outline serverless application endpoints in AWS Lambda and Google Cloud Functions for interacting and utilising Torrent website search APIs

  • Implement job scheduling and service interaction endpoints via GRPC using containers on Kubernetes.

  • Implement storage solutions for source/application data and output data in the form of Google Datastore and MySQL respectively.

  • Link Sauto outputs to the main analysis dataset by creating ETL jobs using Apache Beam & Google Dataflow. (Go & Python)

General

  • Utilise Terraform config management toolset to automate the deployment of Google Cloud infrastructure

  • Utilise Cloudformation tooling (qaz) to automate and deploy AWS Infrastructure

  • Implement CI/CD for various microservices running in Kubernetes, AWS Lambda and Google Functions via Travis CI.

  • Implement Monitoring and Alerts for both AWS and Google Cloud on a single platform utilising Stackdriver.

  • Coordinating 3rd Party Developers and Freelancers/Contractors on various projects

  • Code Reviews

  • Automated Unit and Integration Testing>

  • Create Documentation and Present solutions to stakeholders

July 2016 - July 2017
Cloudreach
Cloud Systems Engineer

Building, Automating, Deploying & Managing infrastructure on AWS while consulting on various Application and Infrastructure migration Projects.

The Met Office - Providing DevOps, Cloud & Programming Training and Consultation

  • Building, Automating, Deploying & Managing infrastructure on AWS as it relates to various internal projects and tooling.

  • Utilise Cloudformation tooling, (qaz, sceptre) to automate application and platform deployments on AWS

  • Consulting on various Application and Infrastructure migration Projects.

  • Run Training sessions for the new Internal Met Office Cloud Operations Team and facilitate knowledge sharing on AWS, Python, DevOPs and more.

Financial Conduct Authority (FCA) - Aiding in Cloud Adoption and Migrations

  • As a Senior member of the team liaise with all Engineers on the project to insure technical consistency and provide support

  • Work with configuration management tooling (Chef) to automate deployments on AWS for various in house services.

  • Utilise Cloudformation tooling, (qaz, sceptre) to automate application and platform deployments on AWS

  • Liaise with Internal Security specialists on AWS Deployments, taking feedback and adjusting services accordingly

  • Create a new model for managing Private DNS on AWS across multiple AWS accounts

October 2014 - July 2016
Vubiquity
Senior Systems Engineer

  • Building, Automating, Deploying & Managing infrastructure on AWS.

  • Consulting on various Application and Infrastructure migration Projects.

  • Training/Up-skilling Internal and External Cloudreach customers on various technologies relating to DevOps and AWS

  • Managing and Troubleshooting servers running on VMWare ESXi

  • Utilise configuration management tools for on-prem server instance provisioning using Salt

Education

2013 - 2016
Daidokoro
BSc Open Degree - Software Engineering

Certifications

Google Certified Associate Engineer
Google Certified Data Engineer
AWS Certified DevOps Engineer
Linux Plus Certified

Skills

Programming Languages
Golang, Python, Rust, NodeJS, Bash
Cloud Infrastructure


AWS, Google Cloud, VMWare
Data Engineering
BigQuery, DataProc, Apache Beam, Spark, Presto, S3, Google Storage, Athena
Microservices & Serverless
AWS Lambda, Google Functions, Docker, Kubernetes, gRPC
Web Technologies & Frameworks
Javascript, Flask, Django, HTML, CSS, REST
Storage
S3, Google Cloud Storage, Postgres, MySQL, BigQuery, Aurora, MongoDB, Redis, Google Datastore, DynamoDB and more...
Monitoring & Alerting
Stackdriver, Cloudwatch, ELK, Splunk
Ops
Jenkins, Travis CI, Terraform, Cloudformation (Qaz), Ansible, Chef

Open Source

Qaz
github.com/daidokoro/qaz

A Cloud Native CLI tool for managing deployments using AWS Cloudformation.

Snippets

A simple Rust script for calculating dividends tax.

Golang script for generating a list of Google Cloud Platform IP Addresses.

Apache Beam example of custom Batching ParDo Function in Python

Testimonials

Very rarely have I worked with anyone who is so diligent and effective in what they do. I have had the pleasure of working with Shaun for over two years during our time at Nahuru. Shaun's ability to solve a number of unique problems as well as display an incredible work ethic is what sets him apart. He was an asset!

customer-name

Ramy Elmasry

Head Of Product Development
@Entura International

Shaun pretty quickly became a pivotal engineer at Vubiquity, quickly learning the technology stack, in house developed software, the business and business rules within our workflows. Whether it was troubleshooting complex technical issues, bringing new technologies into Vubiquity or presenting this technical solutions to others in the team, Shaun did this exceptionally and with a smile on his face. Shaun is an amazing engineer, great person with a team first focus and I’d recommend him to anyone. Was a sad day when he left the organisation.

customer-name

Russel Evans

Head Of Technical Operations
@Trayport

Get in touch

Location
Madrid, Spain