Author Topic: Numerical precision  (Read 299 times)

0 Members and 1 Guest are viewing this topic.

posfan12

  • World Machine Veteran
  • ***
  • Posts: 48
    • View Profile
Numerical precision
« on: March 25, 2018, 10:58:00 AM »
I have a terrain that is 128x128 pixels. This means that when exporting the mesh, the coordinates require 7 digits after the decimal place, since 1/128 = 0.0078125. However, formats such as OBJ and STL only support 6 digits after the decimal place, which ends up being lossy.

How can I work around this problem? It would be great if I could scale all the coordinates up such that they do not use any decimal places at all.

Thanks.
« Last Edit: March 25, 2018, 11:11:47 AM by posfan12 »

Adam Pliska

  • Community Member
  • **
  • Posts: 2
    • View Profile
Re: Numerical precision
« Reply #1 on: April 05, 2018, 10:31:43 AM »
I think this question can be linked with mine - http://forum.world-machine.com/index.php?topic=3590.0