Monthly Archives: July 2023

IOMMU in a nutshell

In the context of a hypervisor, drivers need to access I/O devices. However, the typical I/O overhead is significant, often exceeding 50%, mainly due to the data buffer copying cost. To mitigate this cost, a widely adopted approach is to … Continue reading

Posted in Uncategorized | Leave a comment

Message passing interface

The Message Passing Interface (MPI) is a standardized library specification for message passing (peer 2 peer) between parallel processes or nodes in a distributed computing environment. It provides a portable and efficient way to develop parallel programs that can run … Continue reading

Posted in Uncategorized | Leave a comment

UMA and shared memory

UMA (Uniform Memory Access) is a memory architecture where all processors in a multiprocessor system have uniform access time to the shared memory. In UMA systems, there is no distinction between cores or processors regarding memory access latency. Each processor … Continue reading

Posted in Uncategorized | Leave a comment

Generative AI , transformer and “rise of a beast”

Generative AI Generative AI operates differently from perception-based approaches. While traditional neural networks classify existing data, such as categorizing images of cats and birds, generative models understand the underlying structure of a given dataset and are capable of recreating that … Continue reading

Posted in Uncategorized | Leave a comment

C(++) starting point

Lets start with a simple “Hello World” Now we have two popular compiler suites For GCC the next steps are For LLVM alternatively as follows And a respective Make file looks like the following For C++ the program looks like … Continue reading

Posted in Uncategorized | Leave a comment

URDL model and ROS(2) message types

URDF (Unified Robot Description Format) does not define its own set of message types. Instead, URDF relies on standard ROS (Robot Operating System) message types to exchange data and information. Therefore, the available ROS message types can be used with … Continue reading

Posted in Uncategorized | Leave a comment

Generative ML Transformer Attention

Let’s apply the attention mechanism to translate the German sentence “ich liebe dich”. Suppose we have the following numerical representations for the words e.g. after a worr2vec embedding. German Sentence (numerical representation):“ich” -> [0.2, 0.4, 0.6]“liebe” -> [0.8, 0.3, 0.1]“dich” … Continue reading

Posted in Uncategorized | Leave a comment

API is a promise not a contract

Alan Kay, often recognized as the “father of personal computers,” emphasized that the TCP/IP stack has undergone a complete code replacement over the years. Nevertheless, TCP/IP has maintained its full functionality and has consistently received updates, such as transitioning from … Continue reading

Posted in Uncategorized | Leave a comment