How accurate are fractionals?

#1

Hei,
here is my first post:smiley:
I've noticed axoloti rounds fractionals
in the patcher.
But how many numbers after the decimal
uses the axolti for calculations.
I want to use very precise numbers
to control the lenght of a delay.
thnx Hans

#2

The rounding is is for display purposes, the numbers are represented in a Q format, Q5.27 for control data.

A bipolar dial gives you a visual -64 to 64 mapping from 0xF8000000 to 0x07FFFFFF, you can turn the dials in 0.01 increments if you hold CTRL+Shift. You can use math and shifting objects to get even finer control if needed.

#3

I'll make an example: take a dial/p and set it to 64. That number corresponds to binary 2^27
(64, by the way, is 2^6)
This means that 1 (which is not really decimal 1) is binary 2^21

You can enter numbers up to the third decimal, so we have to divide for another 7 bits, and this takes us to an astonishing 2^14 bits for the smallest number you can input, what's left depends mostly on the object you're working on: many objects will operate with bit shifts and therefore will screw with this precision, but i think there's a big margin for operations.

#4

Okay thnx.
I was asking because my two delays
are not in sync.
One gets a value as delaytime
and the other one a quarter (div 4) of it.
After a while there are out of sync.
I think it has to do with the delay object.