Web crawlers, also known as spiders or bots, are automated programs that systematically browse the World Wide Web to collect information. In this article, we’ll explore how to implement a basic web crawler in Rust, leveraging the language’s performance and safety features. Why Use Rust for Web Crawling? Rust is an excellent choice for building …
Web crawlers, also known as spiders or bots, are automated programs that systematically browse the World Wide Web to collect information. They play a crucial role in various applications, from search engine indexing to data mining and web archiving. In this article, we’ll explore what web crawlers are, how they work, and how to build …
Building a scalable service involves making the service more reliable and easy to manage. In this tutorial we will explore how to deploy a web API built with FastAPI that has a Redis DB for storing the job ids and files and a Redis Queue to manage the jobs and scheduled task. We will be …
How to Deploy a FastAPI Service with Redis & Redis Queue Read More »
In today’s data-driven world, the need for efficient and scalable data conversion tools is ever-growing. In this article we will explores how to build a robust JSON to YAML converter using FastAPI, Redis Queue (RQ), and RQ Dashboard. This powerful combination allows for asynchronous processing, job monitoring, and easy scalability. The Architecture Our application consists …
Building A Scalable App with FastAPI, Redis Queue and RQ-Dashboard Read More »
The inception and popularity of Large Language Models since (2022-till now) has changed the way we look at the world. With Gen AI – ie the use of Large Models to generate content, ideas and media so many things can be quickly done when it comes to content generation. In this blog post, we will …
CLIs – Command Line Interfaces tools are very useful for most developers and system engineers. In most cases it is expected for it to be pretty responsive. However sometimes a task behind a CLI command may be time demanding and in order not to keep users happy, we mostly use spinners and progress bars to …
How to Add Progress Bars & Spinners to CLIs in Python Read More »
In this blog post, we will explore higher order functions and some common algorithms in Rust. A Higher order function is a function that takes in one or more functions as arguments and then returns a function or a value as its result. The most commonest higher order functions include In Rust, you can implement …
Rust Developer RoadMap – Higher Order Functions in Rust Read More »
Rust is a modern systems programming language that is know for it performance and memory safety. As a modern programming language and in the age of Data and AI, can we use Rust for data analysis and data science task? In this tutorial we will explore some of the crates or packages available in Rust …
I am the LORD, and there is none else, there is no God beside me: I girded thee, though thou hast not known me: That they may know from the rising of the sun, and from the west, that there is none beside me. I am the LORD, and there is none else. I form …
Forces Beyond The Visible Part of ElectroMagnetic Spectrum Read More »
When considering web links as sources and targets, network analysis algorithms have several practical applications across various fields. Here are some key uses: Web Page Ranking and Search Engine Optimization (SEO) Spam Detection and Fraud Prevention Network Structure and Community Detection Centrality and Influence Analysis Information Spread and Virality Web Graph Visualization and Exploration Anomaly …
Practical Applications of Network Analysis on URLs Read More »