Top "Precision" questions

Controlling number of decimal digits in print output in R

There is an option in R to get control over digit display. For example: options(digits=10) is supposed to give …

r precision digits r-faq output-formatting

Retain precision with double in Java

public class doublePrecision { public static void main(String[] args) { double total = 0; total += 5.6; total += 5.8; System.out.println(total); } } The above code …

java floating-point double precision

Dividing two integers to produce a float result

Possible Duplicate: Why can't I return a double from two ints being divided My C++ program is truncating the output …

c++ precision integer-division

Double precision - decimal places

From what I have read, a value of data type double has an approximate precision of 15 decimal places. However, when …

c++ c precision ieee-754

How to convert milliseconds to seconds with precision

I want to convert milliseconds to seconds (for example 1500ms to 1.5s, or 500ms to 0.5s) with as much precision …

java precision divide milliseconds

Changing precision of numeric column in Oracle

Currently I have a column that is declared as a NUMBER. I want to change the precision of the column …

sql oracle precision

Convert Java Number to BigDecimal : best way

I am looking for the best way to convert a Number to a BigDecimal. Is this good enough? Number number; …

java numbers precision bigdecimal

fopen / fopen_s and writing to files

I'm using fopen in C to write the output to a text file. The function declaration is (where ARRAY_SIZE …

c file-io precision fopen

How do you round a double in Dart to a given degree of precision AFTER the decimal point?

Given a double, I want to round it to a given number of points of precision after the decimal point, …

dart precision double-precision

How to 'cout' the correct number of decimal places of a double value?

I need help on keeping the precision of a double. If I assign a literal to a double, the actual …

c++ double tostring precision