The arithmetic unit is one of the important components of CPU design. For computation of complex arithmetic functions on hardware, the CORDIC algorithm is an attractive fixed-point algorithm that uses ...

Floating-point arithmetic provides a practical means of representing real numbers on digital computers by encoding them in a finite number of bits for sign, exponent and significand. The IEEE-754 ...

[Editor's note: For an intro to fixed-point math, see Fixed-Point DSP and Algorithm Implementation. For a comparison of fixed- and floating-point hardware, see Fixed vs. floating point: a surprisingly ...

Most AI chips and hardware accelerators that power machine learning (ML) and deep learning (DL) applications include floating-point units (FPUs). Algorithms used in neural networks today are often ...

I am working on a viewshed* algorithm that does some floating point arithmetic. The algorithm sacrifices accuracy for speed and so only builds an approximate viewshed. The algorithm iteratively ...