number精度问题

SQL> show numw
numwidth 10

SQL> select 1/3*3 from dual;

1/3*3
----------
1

SQL> select trunc(1/3*3,9) from dual;

TRUNC(1/3*3,9)
--------------
.999999999

SQL> select trunc(1/3*3,10) from dual;

TRUNC(1/3*3,10)
---------------
1

SQL> select trunc(1/3*3,19) from dual;

TRUNC(1/3*3,19)
--------------------
.9999999999999999999

SQL> select trunc(1/3*3,20) from dual;

TRUNC(1/3*3,20)
--------------------
1

SQL> select dump(1/3) from dual;

DUMP(1/3)
-----------------------------------------------------------------------------
Typ=2 Len=21: 192,34,34,34,34,34,34,34,34,34,34,34,34,34,34,34,34,34,34,34,34

SQL> select dump(1/3*3) from dual;

DUMP(1/3*3)
-------------------------------------------------------------------------------------------------
Typ=2 Len=21: 192,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100

SQL> select dump(1) from dual;

DUMP(1)
------------------
Typ=2 Len=2: 193,2

SQL> set numw 100000
SP2-0267: numwidth option 100000 out of range (2 through 50)

由实验可以看出number 最大能精确到小数点后面50位。

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值