TLDR Scrapper and Sync Data to Notion

A Nodejs and cheerio news scraper that scrapes the most recent tldrtech page and returns Programming and Github information, then uploads that data into the notion database

How does it works?

It scrapes data from tldr.tech site and uploads to notion

Prequisites

To get started, you'll need a notion account, a notion page, and a craete database.

Getting NOTION_API_KEY and DATABASE_ID

1. Go to Notion Dashbaord

2. Click on New page

3. Click on table

4. Click on New database

5. Create new databse

6. Check the url and make a note of Databse ID

Take note of this after /  and before ? mark this is your DATABASE_ID

7. Click on New integration

8. Type your integration name

9. Click on Submit

12. Click on show

Take a note of this screate key it is your notion key

13. Click on Share

14. Click on invite box

15. Click on your integration name and click on Invite

16.Create .env file into the root directory

NOTION_API_KEY='<your_notion_api_key>'

DATABASE_ID='<your_database_id>'

Installation

1. Clone the Repo

   https://github.com/amrohan/tldr-tech-scraper

2. Install packages

   yarn install

3. Run the script

   yarn dev

4. Make your desired modifications and rerun the script.

Hosting

Use your preferred hosting service to deploy this scrapper.

1. render
2. Heroku
3. Digital Ocean
4. AWS
5. GCP

Just add environment variables to your favorite hosting service.