Blog Posts:
-
22/06/23
I open sourced Teaser, and v.1.0.0-alpha is up on the Google Play Store! Exciting times!
Google Play -
11/05/23
I've been working on a new project called Teaser. It's TikTok for OnlyFans.
-
19/01/23
I deployed the production environment of http://memefeed.xyz today. However, in a few days, I'll be migrating the production to another computer so I can truly separate the development and production databases. Just need to wait for the RAM and new monitor I've ordered to arrive. I have plans for LTS with this project. I want to re-implement popular frontends such as TikTok’s desktop view, take a deep dive into web-application security, add asynchronous task queues for preemptively rendering paginated pages and more. It was pretty fun getting feedback from my friends (the initial beta testers), and iterating on their suggestions to get to the current rendition of memefeed. I think the next big update will revamp the UI by reimplementing TikTok's alongside adding interest-based feeds. I plan on doing this for Imgur and Pinterest's UIs as well. Here's what the UI looks like right now:
-
08/01/23
I made a band. I'll be playing as lead guitarist and vocalist. Wish me luck!
-
12/12/22
I completed an Agile Inception Deck Proposal for my new project, Memefeed. The Agile Inception Deck approach (henceforth AID approach) was fascinating to put into practice. In the past, I had written agile proposals by creating epics/user stories, determining the layering of system architecture and modelling how users would interact with the system. The AID approach made me focus on business value proposition of my product.
The AID approach made me focus on the value my product would provide to a business. When designing system architecture, I applied the three-layered architecture model and reviewed my product from a purely technical perspective. Using the AID approach helped me categorize the "organizational resources" that were available alongside the correct requirements to prioritize.
What's next?
I'm going to continue adding to the lucidchart system architecture diagram. I'm also writing up Epics and User stories on Jira. I have identified MoSCoW Prioritisation as a methodology to look into for refining my requirement prioritisation in this project.
-
6/12/22
I created a dashboard from the theLook eCommerce. It was a pretty interesting project, as I ended up learning how to use Google Bigquery for storage & queries, schedule updating models in dbt and visualise data using Google Data Studio. I learnt many things like the best practices for querying BigQuery datasets (including technical details like Broadcast joins) and Kimball's Dimensional Modelling. Terraform fell outside my use-case as the only cloud provider I used was the Google Cloud ecosystem, due to the 1TB of free queries on public datasets and and the free trial they offer to each account. Likewise, using Airflow would have added costs and complexity beyond my use case, but I read the documentation and took notes here.
I'll write a longer follow-up blog post on this, but you can view the dashboard I created here and my code here.
I'm planning on writing an injestion script to extract data from Twitter/Amazon and using Github Actions to deploy my code to a Google cloud function. Then to schedule a cronjob with google scheduler to continue to injest data into GCS. I'm avoiding Airflow for this project due to the unnecessary complexity and costs it adds.
-
27/11/22
I discovered the field of Data Engineering a week ago and it looks really interesting!
Right now, I'm working on a DE project using Docker, Terraform, Google Bigquery, dbt, Data Studio, Apache Spark and Airflow.
Following the DataTalksClub Zoomcamp!