Benjamin QoChuk, PhD - OpenGenus IQ: Learn Computer Science

BERT base vs BERT large

BERT base model has 12 encoder layers stacked on top of each other whereas BERT large has 24 layers of encoders stacked on top of each other.

Machine Learning (ML)

The Idea of Indexing in NLP for Information Retrieval

We have explored the fundamental ideas for Information Retrieval that is Indexing Data. We have covered various types of indexes like Term document incidence matrix, Inverted index, boolean queries, dynamic and distributed indexing, distributed indexing and Dynamic Index.

Machine Learning (ML)

Wide and Deep Learning Model

Wide and Deep Learning Model is a ML/ DL model that has two main components: Memorizing component (Linear model) and a Generalizing component (Neural Network) and a cross product of the previous two components. Wide and Deep Learning Model is used in recommendation systems.

Machine Learning (ML)

RoBERTa: Robustly Optimized BERT pre-training Approach

RoBERTa (Robustly Optimized BERT pre-training Approach) is a NLP model and is the modified version (by Facebook) of the popular NLP model, BERT. It is more like an approach better train and optimize BERT (Bidirectional Encoder Representations from Transformers).

Machine Learning (ML)

Filtering spam using Naive Bayes

Naive Bayes is a Bayes Theorem-based probabilistic algorithm used in data analytics for email spam filtering. In this article, we have explored the step to filter spam using Naive Bayes in depth.

Software Engineering

Capitalize letters in Python

In this article, we have covered how to capitalize the first letter using capitalize() in Python, convert the entire string to upper-case, convert the entire string to lower-case and capitalize first letter of each word.

Machine Learning (ML)

Disadvantages of GANs || Am I real or a Trained Model to write?

We have explored the problems with GANs in this article and have divided them into two major parts: General Problems with GANs and Technical Disadvantages of GANs.

Machine Learning (ML)

Elastic Net Regularization

Elastic Net Regularization is a regularization technique that uses both L1 and L2 regularizations to produce most optimized output. This is one of the best regularization technique.

Software Engineering

Implementation of ls command in C

In this article, we have implemented the ls command in C using dirent header library. ls command is used to list the files and directories in a given location.

Machine Learning (ML)

BERT and SEARCH: How BERT is used to improve searching?

In this article, we have explored how BERT model can be used to improve search results in search engines like Google Search, Bing and others.

Machine Learning (ML)

Introduction to Multilingual BERT (M-BERT)

We explored what is Multilingual BERT (M-BERT) and see a general introduction of this NLP model.

Machine Learning (ML)

Heaps' law in NLP for Frequency of Words

Heap's Law in NLP is a relation between the number of unique words to the total number of words in a document. It is, also, known as Herdan's law.

Software Engineering

Introduction to Single Page Applications with Flask and AJAX

Let us have a look at what single-page applications are and how can we create one using AJAX, with Flask as the back-end.

Software Engineering

How Email Systems Are Designed?

Through this article, you will get a good insight into "How Email Systems like GMail and Outlook are Designed?". The key is to understand that email is a default way of communication on the web and is not same as a instant messaging platform.

Software Engineering

Strings in Python [Complete Guide]

In this article, we will learn how to implement strings in Python and explore the various string operations that we can use.

Machine Learning (ML)

Zipf's Law in NLP

According to Zipf's law, the frequency of a given word is dependent on the inverse of it's rank . Zipf's law is one of the many important laws that plays a significant part in natural language processing.

Software Engineering

List of Top Users in CodeForces

In this article, we will make a list of all the users of Codeforces and store their information in a JSON file. We will use the json and urlib.request library of python for the purpose.

Software Engineering

File Hosting Service in Django

In this article, we will learn to create a file hosting service webpage in Django wherein one can host their files on the local server and generate a shareable URL link to access the file.

Software Engineering

Basic Bits hacks in Python

We have covered several basic bit hacks in Python which everyone should know to write optimized code. Tricks include find sign of an integer, negate an integer and more.

Software Engineering

Typecasting in C

We have explored Typecasting in the C language. The definition, categories of Typecasting, Why it is used and How, along with many examples so that it will be easy to understand.

Machine Learning (ML)

Adversarial Sample Transferability in Machine Learning: Attacks

We have discussed about what adversarial machine learning is and what transferability attacks are. The ideas are from Ian Goodfellow.

Machine Learning (ML)

Can Machine Learning (ML) be secure?

We answer the question "Can Machine Learning (ML) or Artificial Intelligence (AI) be secure?". We explore different types of attacks on Machine learning, defense strategies and more

Machine Learning (ML)

Summary: The Case for Learned Index Structures

This outlines and evaluates the potential of a new approach to build indexes that is the merge of Algorithms/ Data Structures and Machine Learning.

Machine Learning (ML)

Adversarial Examples are not Bugs but are Features of AI

Adversarial Vulnerability is a direct result of our models' sensitivity to well-generalizing features in the data. We explored the research paper.

Machine Learning (ML)

The Indirect Convolution Algorithm

Indirect Convolution is as efficient as the GEMM primitive without the overhead of im2col transformations - instead of reshuffling the data, an indirection buffer is introduced.