Project

General

Profile

Actions

Bug #5477

closed

to_f function / multiplication bug

Added by notomodungwa (Noto Modungwa) over 12 years ago. Updated over 12 years ago.

Status:
Rejected
Assignee:
-
Target version:
ruby -v:
ruby 1.9.2p174 (2011-01-28 revision 30696) [x86_64-darwin10.6.0]
Backport:
[ruby-core:40308]

Description

This is posted on stack overflow but I thought I should report it here
Hi I just ran into an issue where ruby's to_f function is giving me inconsistent results.

ruby-1.9.2-head :026 > 8.45.to_f * 100 => 844.9999999999999

ruby-1.9.2-head :027 > 4.45.to_f * 100 => 445.0

ruby-1.9.2-head :028 > 4.35.to_f * 100 => 434.99999999999994

My workaround is to simply round the result this way

ruby-1.9.2-head :029 > (4.35.to_f * 100).round => 435

After more playing around I realised that the issue might be with the multiplication operator "* 100"

Actions

Also available in: Atom PDF

Like0
Like0Like0