Preserving wisdom.
Sharing culture.

Finally managed to get my api id and hash from Telegram.

I can now fetch data from channels using Telethon.

I managed to extract more than 7,000 messages starting from 2017.

The channel I am extracting from is ababaloch.

My intention is to build an api that will provide amharic proverbs.

I think I will learn a lot by doing that.

I have already set up a github actions cron job to fetch the proverbs 3 times per day and update my database.

I triggered the workflow manually and it run without any errors.

Currently, I am using SQLite for the db, and there was no db update since there was no new post on the channel.

I will check the db again after something is posted on the channel.

The cron job run successfully and I got updates on the db.

In addition to the text, I am now saving the plain English translation, and the meaning of the proverb in both Amharic and English.

I am using Gemini to handle the translation and to extract the meaning.

I am also saving a confidence score and an indicator if a review is needed

I also set up another cron job to handle the Gemini translations.

I am making it run 10 times per day.

I have migrated 2,900 proverbs out of the 7,189 proverbs currently in the db and we are adding 3 per day.

I will still have to analyze how many of those translations need a review or have low confidence score.

One of the cron jobs managed to run for 37 minutes and processed 1,000 proverbs in a go🤯

On average the cron jobs run for 2 minutes and they parse 50-150 proverbs.

Its been a while since our AI cron job managed to parse all the existing proverbs (that's 7,000+).

I am currently building the backend using NestJS and I have so far figured out auth (jwt + passport, API key), rate limiter (Nest throttling), and a couple of endpoints to provide the proverbs.

Both our scrapper and our parser are still running and they still fetch proverbs and add translation and meanings to our db.

Currently working on the frontend.

I haven't wired up everything with the backend.

I really don't know why I am dedicating my time and effort on this thing.

I am learning things but still...🤦‍♂

I think everything will be easier once I set up a design system and add a bit more logic to the backend.

ውል ያዋውላል ታንኳ ያሻግራል አቧራ ያስላል

Bars🔥

This is the translation I got in my db

Bruh💀

I think I will have to abandon this project for sometime

SQLite and the N+1 (no) problem

Today I found out about wuchale.

It is an internationalization (i18n) toolkit and is actually named after the treaty of Wuchale.

And yep it is made by an Ethiopian.

You can give the repo a star here.

Got back on it.

Made api keys optional.

And the mobile app is running.

using capacitor with sveltekit for the mobile app.

Let's see if we can make some widgets.

I got a widget.

All it took was writing a couple of xml files and a java file to fetch, cache, and display the proverbs.

I have never been this much hesitant to make a landing page.

The project is almost done.

some proverbs are just outright weird and rude