Monthly Archives: August 2023

Likelihood and probability

Posted in Uncategorized | Leave a comment

Time, neural network and transformer

Lets us start with time. Time allows to introduce a sequential order – one after the other. When we look for example on usual word embedding it is not just assigning a word a single number, it is usually an … Continue reading

Posted in Uncategorized | Leave a comment

Deep Learning, Generative AI and Foundation models

To begin with, let’s clarify our discussion. AI, or Artificial Intelligence, is the field that involves using computers to perform tasks that resemble human abilities. To achieve this, we need to implement these tasks effectively. One approach to achieving this … Continue reading

Posted in Uncategorized | Leave a comment

Practical attention mechanism

Google created the “Transformer” neural network architecture (check the provided link) to tackle the difficulties associated with sequence transduction, a challenge that arises when working with sequence-to-sequence models. The core concept in this architecture revolves around a technique known as … Continue reading

Posted in Uncategorized | Leave a comment

Physical MAC encoding

MACs are physically encoded via different technical approaches e.g.,:

Posted in Uncategorized | Leave a comment