Queue tasks in node.js & express

22 years old application and web developer. Certified in C, C++, And Java. Completed IT Trainings in Web Development, Javascript, MERN and web Designs, Android.

Step 0: Setup

In this project, we would be using a package known as "bull" which is great for queuing jobs in the background. But in order to run the bull package, we must have Redis installed on our machine. So, head over to https://redis.io/download and download the stable version of Redis. After successful installation, we are good to go.

Step 2: Basic express server

In this step, we would be creating a simple express server up and running.

// index.js const express = require('express'); const app = express(); const PORT = process.env.PORT || 8000; app.get('/', (req, res) => { res.end('Hello from the server') }) app.listen(PORT, () => console.log(`Server started at PORT:${PORT}`))

let's start the server node index.js.

Step 3: Implementing Queue

Now, in this step, we would be implementing the queue feature. To understand the implementation queue, let's simulate a fake situation. Please read and understand the following situation carefully.

A user visits your website and sees a form. He fills up the form and uploads some high-quality photos and clicks on submit. The request is then sent to the backend along with the data and photos he uploaded. Now, on the server, you want to first compress the images and upload the image to let's say amazon s3 bucket and then update the URL of images in the database.

As you can already guess, the above scenario is a time taking process. If you do all the above-mentioned tasks on the main thread it would highly affect the performance of your server and users have to wait really long. So, to avoid that let's code the above scenario with queues.

let's start the server node index.js

Now, I would fire up my postman and try to send POST requests at /submit route.

Great! I got a "successfully queued" response. Now let's check our server console.

As you can see, after 5 seconds, I got a log saying "Compression and upload done" as I set a time out of 5 seconds.

I hope that now you have understood how you can queue tasks in nodejs and express server.

Queue tasks in node.js & express

Comments

More from this blog

FullStack Twitter Clone

Tic Tac Toe Game in Javascript

Deploying Node.js functions to AWS Lambda | Serverless

Uploading images to firebase storage with node.js

How I built a real-time collaborative IDE with video chat

Step 0: Setup

Step 1: Project Setup and installing dependencies

Step 2: Basic express server

Step 3: Implementing Queue

Command Palette

Comments

More from this blog

Step 0: Setup

Step 1: Project Setup and installing dependencies

Step 2: Basic express server

Step 3: Implementing Queue