Numeric overflow

Public support forum for peer to peer support with related to the Visual Objects and Vulcan.NET products
Post Reply
mbrown
Posts: 9
Joined: Thu Jul 06, 2017 11:35 am

Numeric overflow

Post by mbrown »

I have an application from VO that does a long series of complicated calculations (too much to show here), and uses the run-time compiler to evaluate expressions read from a file, using code-blocks. While using the Vulcan run-time library it was working well, but since updating to version 2.2, and changing to the X# library, it occasionally fails with a numeric overflow error. Inspecting the variable concerned, a USUAL type, at the point of failure in the debugger, shows it to contain a FLOAT with a value of 24736.73, but the 'Digits' property is only 4. Unfortunately I haven't been able to reproduce it in a simple example. I have fixed it by using “result := REAL8(result)”, but is there a better way, or is this a bug?
User avatar
robert
Posts: 4518
Joined: Fri Aug 21, 2015 10:57 am
Location: Netherlands

Numeric overflow

Post by robert »

Michael,
This sounds like a bug.
Can you create a small reproducable example ?

Robert
XSharp Development Team
The Netherlands
robert@xsharp.eu
mbrown
Posts: 9
Joined: Thu Jul 06, 2017 11:35 am

Numeric overflow

Post by mbrown »

No, sorry I haven't been able to reproduce it in a simple example.
Post Reply