You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Test case is 64M points of SPI flash protocol analysis at 250 Msps. As time advances far enough there are floating point rounding issues in the X coordinates being passed to the shader and things start to look ugly. Moving further to the right makes things even worse, the first few milliseconds of the capture are totally fine.
We might need to switch to integer valued coordinates or double precision or something. Not sure on details yet.
The text was updated successfully, but these errors were encountered:
Test case is 64M points of SPI flash protocol analysis at 250 Msps. As time advances far enough there are floating point rounding issues in the X coordinates being passed to the shader and things start to look ugly. Moving further to the right makes things even worse, the first few milliseconds of the capture are totally fine.
We might need to switch to integer valued coordinates or double precision or something. Not sure on details yet.
The text was updated successfully, but these errors were encountered: