Commit 79ef2af1 authored by Eva Darulova's avatar Eva Darulova

Merge branch 'master' into certif-merge

Conflicts:
	README.md
	src/main/scala/daisy/Component.scala
	src/main/scala/daisy/Context.scala
	src/main/scala/daisy/Main.scala
	src/main/scala/daisy/analysis/AbsErrorPhase.scala
	src/main/scala/daisy/analysis/RangeErrorPhase.scala
	src/main/scala/daisy/analysis/SpecsProcessingPhase.scala
	src/main/scala/daisy/backend/CodeGenerationPhase.scala
	src/main/scala/daisy/frontend/ASTExtractors.scala
	src/main/scala/daisy/lang/Identifier.scala
	src/main/scala/daisy/lang/PrettyPrinter.scala
	src/main/scala/daisy/lang/ScalaPrinter.scala
	src/main/scala/daisy/lang/Trees.scala
	src/main/scala/daisy/tools/FinitePrecision.scala
	src/main/scala/daisy/tools/RoundoffEvaluators.scala
	src/main/scala/daisy/utils/DebugSection.scala
	src/main/scala/daisy/utils/Interval.scala
	src/main/scala/daisy/utils/IntervalSubdivision.scala
parents dace6b4a e7a61fc8
Copyright (c) 2017 MPI-SWS, unless otherwise specified. All rights reserved.
This software was developed by the Automated Verification and Approximation (AVA)
group of the Max Planck Institute for Software Systems (MPI-SWS), Saarbruecken
and Kaiserslautern, Germany.
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions are met:
1. Redistributions of source code must retain the above copyright notice,
this list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the above copyright notice,
this list of conditions and the following disclaimer in the documentation
and/or other materials provided with the distribution.
THIS SOFTWARE IS PROVIDED BY THE REGENTS AND CONTRIBUTORS ''AS IS'' AND ANY
EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE REGENTS OR CONTRIBUTORS BE LIABLE FOR ANY
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON
ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
The views and conclusions contained in the software and documentation are those
of the authors and should not be interpreted as representing official policies,
either expressed or implied, of MPI-SWS.
\ No newline at end of file
# Project Daisy
Daisy is a framework for accuracy analysis of numerical programs whose aim
is to be modular and extensible. It is currently very much work in progress,
so stay tuned for updates and new features.
The current functionality includes:
- static analysis of roundoff errors in arithmetic expressions for various
floating-point and fixed-point precisions
- code generation of fixed-point arithmetic code from mathematical expressions
- dynamic analysis using rationals or arbitrary precision
## Documentation
To come soon.
## First steps
......@@ -111,6 +98,7 @@ Currently, this is
[install it first on your machine](https://github.com/Z3Prover/z3).
* MPFR: Daisy uses a [Java binding](https://github.com/kframework/mpfr-java).
(TODO: figure out whether we used the static or dynamic binding)
* Coq: Version 8.5pl2 if you want to extract certificates for it, [install it](https://coq.inria.fr/download)
......@@ -120,6 +108,19 @@ Currently, this is
$ export HOLLIGHT_HOME=path_to_hol_light_git
```
## Documentation
## Intellij Idea Setup
To run Daisy in Intellij Idea you first have to install Scala Plugin: Settings (Ctrl + Alt + S) -> Plugins. Choose Scala in the list and press "Install JetBrains Plugin ...". Then let Idea know where is your Scala (or make sure Scala SDK is already there): Project Structure -> Global Libraries -> New Global Library -> Scala SDK -> select the source folder for the SDk on your machine.
Also make sure the Java SDK is set up for Idea (Project Structure -> SDKs -> check that your JDK is here or add it here).
Choose File -> New -> Project from Existing Source -> choose the path to the build.sbt file
or
File -> New -> Project from Version Control -> Git -> put git-rts@gitlab.mpi-sws.org:AVA/daisy.git into the URL field and select the destination folder for source files to be copied.
After the setup run Daisy in the Terminal of Intellij Idea using sbt as described above.
Acknowledgements
----
......
Baseline sample size: 10000000
MidSample sample size: 50000
SmallSample sample size: 256
\ No newline at end of file
absolute errors (dynamic intervals&AA smt&AA subdivAll&AA
BatchReactor-out1 4.30810942475545743e-16 6.730727086790012e-16 6.730727086790012e-16 6.730727086790012e-16
BatchReactor-out2 1.31024080474162474e-15 2.005340338229189e-15 2.005340338229189e-15 2.005340338229189e-15
BatchReactor-state1 4.17745171787942126e-16 5.221517662690189e-16 5.221517662690189e-16 5.221517662690189e-16
BatchReactor-state2 3.39464900633856814e-16 4.0375688903360185e-16 4.0375688903360185e-16 4.0375688903360185e-16
BatchReactor-state3 3.51702222900485139e-16 5.464378949326942e-16 5.464378949326942e-16 5.464378949326942e-16
BatchReactor-state4 4.49629222742942147e-16 5.898195343592705e-16 5.898195343592705e-16 5.898195343592705e-16
BetaDistribution-aParameter 1.58028618801244501e-10 3.6359892874315847e-10 3.6359892874315847e-10 3.6359892874315847e-10
BetaDistribution-bParameter 1.76201486324092191e-13 4.096722960866828e-13 4.096722960866828e-13 4.096722960866828e-13
Bsplines-bspline0 2.74675031982032091e-17 1.0639637319324417e-16 1.0639637319324417e-16 1.0639637319324417e-16
Bsplines-bspline1 1.47791089628745422e-16 5.181040781584064e-16 4.255854927729767e-16 3.608224830031759e-16
Bsplines-bspline2 1.41439862880906006e-16 5.181040781584064e-16 3.9320398788807626e-16 3.978299171573478e-16
Bsplines-bspline3 2.73170682411068242e-17 5.088522196198634e-17 5.088522196198634e-17 5.088522196198634e-17
Doppler-doppler 6.59432499828512494e-14 3.7460851093122305e-13 3.7460851093122305e-13 1.2564142139033842e-13
Floudas-floudas1 1.67881180044192041e-13 3.339550858072471e-13 3.339550858072471e-13 3.339550858072471e-13
Floudas-floudas26 1.79816016486124102e-13 5.839773109528323e-13 5.626610288800293e-13 -
Floudas-floudas33 1.66257848574834948e-13 3.1796787425264483e-13 3.1796787425264483e-13 3.1796787425264483e-13
Floudas-floudas34 6.66133814775093924e-16 1.3322676295501878e-15 1.3322676295501878e-15 1.3322676295501878e-15
Floudas-floudas46 4.44089209850062616e-16 4.440892098500626e-16 4.440892098500626e-16 4.440892098500626e-16
Floudas-floudas47 1.10547437245066556e-14 1.1546319456101628e-14 1.1546319456101628e-14 1.1546319456101628e-14
Himmilbeau-himmilbeau 2.87853330804370017e-13 1.5631940186722206e-12 5.897504706808833e-13 5.897504706808833e-13
JetEngine-jetEngine 4.33886755524488512e-12 - 5.327000053330094e-09 2.6333979441517408e-11
Kepler-kepler0 3.51637777195018777e-14 8.012257524114829e-14 - 5.983302742151864e-14
Kepler-kepler1 9.66238015932647770e-14 3.663707559553586e-13 - 2.1853860943110704e-13
Kepler-kepler2 5.24232013276063837e-13 2.0807206624340324e-12 - 1.4631077682736305e-12
Octave-jcobi1 4.77171513830522008e-15 - - -
Octave-jcobi2 2.62546636761320421e-13 - - -
Octave-jcobi3 5.07614013607969122e-13 - - -
Octave-jcobi4 2.02373875532033877e-13 - - -
Physics-linearOptics 9.84034380102329843e-07 - - -
Physics-linearOptics2 1.19802519113322151e-03 0.0016698220424586907 0.0016688683681422845 0.0016698215767974034
Physics-linearOptics3 1.20885261343469392e-03 0.0016637449152767658 0.0016637449152767658 0.0016637449152767658
Physics-quantumWalk 1.15092407706237163e-16 - - -
Physics-superFluidityEqn13 3.84919409355732962e-06 - - -
Physics-superFluidityEqn7 1.17807322293061605e-07 - - -
Physics-teaWhistle1 1.23523479659870831e-11 - - -
Physics-teaWhistle2 2.82157537828210842e-06 - - -
Physics-teaWhistle3 0e+00 - - -
Physics-teaWhistle4 4.11580020613304225e-04 - - -
Product-product8 6.93167072265658543e-13 3.68682862017522e-12 3.68682862017522e-12 -
RigidBody-rigidBody1 1.82255776513383471e-13 2.398081733190338e-13 2.398081733190338e-13 2.398081733190338e-13
RigidBody-rigidBody2 1.71057133584730592e-11 2.3170798613136867e-11 2.3170798613136867e-11 2.3170798613136867e-11
Science-carbonGas 3.26741526774013429e-09 1.9281699025519574e-08 1.3693763577826702e-08 6.871945265993286e-09
Science-predatorPrey 8.84890266518559898e-17 1.354257102009066e-16 1.354257102009066e-16 1.2747600141453324e-16
Science-verhulst 1.56970750122585468e-16 3.530139169243032e-16 2.9750276569304536e-16 2.5036761764889345e-16
Sum-sum8 1.68753899743023794e-14 2.8421709430404007e-14 2.8421709430404007e-14 -
Traincar1-out1 2.06613895029477134e-12 3.214495336578693e-12 3.214495336578693e-12 2.965805379062658e-12
Traincar1-state1 2.13182679149083056e-15 3.3501521869150342e-15 3.3501521869150342e-15 3.3501521869150342e-15
Traincar1-state2 4.56275132751377491e-15 5.918139242555575e-15 5.918139242555575e-15 5.918139242555575e-15
Traincar1-state3 4.47578951191531856e-15 5.021218765213428e-15 5.021218765213428e-15 5.021218765213428e-15
Traincar2-out1 9.06017885622631260e-13 1.9968471320908066e-12 1.9968471320908066e-12 1.709743457922741e-12
Traincar2-state1 6.25922152079722635e-15 8.504698710362115e-15 8.504698710362115e-15 -
Traincar2-state2 5.82881431801375824e-15 8.503289222308875e-15 8.503289222308875e-15 -
Traincar2-state3 5.31597316759104618e-15 7.661673470546427e-15 7.661673470546427e-15 -
Traincar2-state4 6.09544763199194055e-15 6.773236282306765e-15 6.773236282306765e-15 -
Traincar2-state5 9.00104688161795346e-15 1.2990409834275336e-14 1.2990409834275336e-14 -
Traincar3-out1 1.26348921800808350e-11 3.5640823625726625e-11 3.5640823625726625e-11 -
Traincar3-state1 3.71758129539108646e-15 5.654874012186474e-15 5.654874012186474e-15 -
Traincar3-state2 3.69958068137793260e-15 5.912764319229369e-15 5.912764319229369e-15 -
Traincar3-state3 3.89240317216905590e-15 5.241684292937008e-15 5.241684292937008e-15 -
Traincar3-state4 7.65630103670528948e-15 9.50155651044133e-15 9.50155651044133e-15 -
Traincar3-state5 7.00838258026988150e-15 8.606264716321969e-15 8.606264716321969e-15 -
Traincar3-state6 5.39450502914437643e-15 7.718862171563698e-15 7.718862171563698e-15 -
Traincar3-state7 4.82772481403246871e-15 6.83044512866162e-15 6.83044512866162e-15 -
Traincar4-out1 1.35877862108124356e-10 3.587956598494202e-10 3.587956598494202e-10 -
Traincar4-state1 4.27804044103960323e-15 6.2178322689775715e-15 6.2178322689775715e-15 -
Traincar4-state2 4.04382313720281087e-15 6.661946567629203e-15 6.661946567629203e-15 -
Traincar4-state3 3.91129971298554487e-15 6.217740288354612e-15 6.217740288354612e-15 -
Traincar4-state4 3.96419752886513753e-15 5.773668914172917e-15 5.773668914172917e-15 -
Traincar4-state5 7.45616192268521844e-15 1.141919023981192e-14 1.141919023981192e-14 -
Traincar4-state6 7.62144941921421183e-15 1.0436405682874642e-14 1.0436405682874642e-14 -
Traincar4-state7 7.13566705015584382e-15 9.5482246655172e-15 9.5482246655172e-15 -
Traincar4-state8 6.29560403438896365e-15 8.66020080346763e-15 8.66020080346763e-15 -
Traincar4-state9 5.97330061504762554e-15 7.771961232127201e-15 7.771961232127201e-15 -
Turbine-turbine1 5.50800852880808746e-15 6.04371864298553e-14 5.421993749195443e-14 1.7892256970774354e-14
Turbine-turbine2 7.38845967265856649e-15 8.410176828459292e-14 6.811455672999066e-14 1.5842865025948352e-14
Turbine-turbine3 3.63747943939461030e-15 4.7231852167879186e-14 3.923824639057806e-14 9.716895626166913e-15
UnivariateEvenLonger-f0 5.98577424917690090e-13 3.752553823233031e-12 2.1682987323412453e-12 1.46585219025164e-12
UnivariateEvenLonger-f1 3.33066113860200901e-16 - - 1.2983192636536467e-15
UnivariateEvenLonger-f2 6.66132764727777398e-16 1.1723955140041656e-13 4.618831754523999e-14 9.903797721039754e-15
UnivariateEvenLonger-f3 9.24622716665814000e-17 2.5508566613152706e-16 2.134523027080837e-16 1.868115632321407e-16
UnivariateEvenLonger-f4 2.22036917386365452e-15 9.148237722911291e-14 4.0412794619706935e-14 8.309943296646378e-15
UnivariateEvenLonger-f5 8.78054721915979480e-16 9.103828801926285e-15 7.113233613242899e-15 7.305267502033531e-15
UnivariateEvenLonger-f6 9.84550981252363386e-16 - - 1.665334536937735e-15
UnivariateEvenLonger-f7 3.30324011874627554e-17 3.556183125752455e-16 1.8676737673778423e-16 1.847398102550191e-16
UnivariateEvenLonger-f8 7.48642781405405111e-15 - 5.56165288736423e-13 2.6063020734561265e-14
UnivariateEvenLonger-f9 5.55108204483623473e-17 - - 1.0043285730083942e-15
UnivariateLonger-f0 1.94389020953887736e-17 5.865533753146579e-17 4.824699667560495e-17 4.4777549723651333e-17
UnivariateLonger-f1 1.31484393584434281e-15 5.963556759611849e-08 2.1642977431081015e-12 2.0473507333918533e-12
UnivariateLonger-f2 4.95385742768136663e-16 7.771561172376096e-16 7.771561172376096e-16 7.771561172376096e-16
UnivariateLonger-f3 1.77630588928761818e-15 6.217248937900877e-15 6.217248937900877e-15 6.217248937900877e-15
UnivariateLonger-f4 2.22044604925031308e-16 - 1.1726906912993155e-11 -
UnivariateLonger-f5 4.99590301022686568e-16 9.992007221626409e-16 9.992007221626409e-16 9.992007221626409e-16
UnivariateLonger-f6 2.21516143958162996e-15 3.552713678800501e-15 3.552713678800501e-15 3.552713678800501e-15
UnivariateLonger-f7 1.32444885482656506e-15 5.329070518200752e-15 5.329070518200752e-15 5.329070518200752e-15
UnivariateLonger-f8 2.54175214567126025e-17 5.431852884152377e-17 5.431852884152377e-17 5.084908188957016e-17
UnivariateLonger-f9 4.25109500067761467e-15 2.1319751519754972e-14 1.8655216260654596e-14 7.283930403279016e-15
UnivariateShort-f0 3.31112213706641267e-16 8.881784197001252e-16 8.881784197001252e-16 8.881784197001252e-16
UnivariateShort-f1 2.65722907731750894e-16 5.551115123125784e-16 5.551115123125784e-16 5.551115123125784e-16
UnivariateShort-f2 3.88571990454081866e-16 7.771561172376096e-16 7.771561172376096e-16 7.771561172376096e-16
UnivariateShort-f3 2.17094399123003981e-16 7.105427357601002e-15 2.10983032260248e-15 4.670593413940314e-16
UnivariateShort-f4 5.55111512312578270e-17 1.5987211554602308e-14 1.515454428613344e-14 1.843551074778872e-16
UnivariateShort-f5 1.11022302462515654e-16 3.552713678800501e-15 1.887379141862766e-15 2.335296706970157e-16
UnivariateShort-f6 0e+00 6.661338147750939e-16 6.661338147750939e-16 6.661338147750939e-16
UnivariateShort-f8 4.44089209850062616e-16 2.1316282072803006e-14 7.771561172376096e-15 9.119963531003881e-16
UnivariateShort-f9 8.88177815208773386e-16 3.552713678800501e-15 3.552713678800501e-15 3.552713678800501e-15
relative errors dynamic intervals&AA smt&AA subdivAll&AA
BatchReactor-out1 1.54529598732275609e-10 NaN NaN -
BatchReactor-out2 2.63528748087610845e-10 NaN NaN -
BatchReactor-state1 9.10726565782358207e-12 NaN NaN -
BatchReactor-state2 1.81269314637773540e-12 NaN NaN -
BatchReactor-state3 4.22746911910847322e-11 NaN NaN -
BatchReactor-state4 3.83412069570762673e-12 NaN NaN -
BetaDistribution-aParameter 6.39639881964809984e-11 NaN NaN -
BetaDistribution-bParameter 3.10618065353862184e-16 NaN NaN -
Bsplines-bspline0 2.74384318137096469e-16 NaN NaN -
Bsplines-bspline1 7.15732773921734855e-16 NaN 2.5610159330040828E-15 1.1577191968016339e-14
Bsplines-bspline2 2.54322228221909569e-16 NaN 2.3592239273284576E-15 7.626132597265452e-16
Bsplines-bspline3 2.76321560521310465e-16 NaN NaN -
Doppler-doppler 7.05861472638061530e-16 1.2723419098246272E-11 1.2723419098246272E-11 1.4494007244151482e-13
Floudas-floudas1 5.45634781050316617e-16 NaN NaN -
Floudas-floudas26 1.83719197814486664e-12 NaN NaN -
Floudas-floudas33 6.04013250415394411e-16 NaN NaN -
Floudas-floudas34 2.18948457656550688e-16 NaN NaN -
Floudas-floudas46 1.11022191432642766e-16 NaN NaN -
Floudas-floudas47 4.23533405603622239e-16 NaN NaN -
Himmilbeau-himmilbeau 7.18609916333463484e-14 NaN NaN -
JetEngine-jetEngine 1.32219077808522476e-10 - NaN -
Kepler-kepler0 5.35034988364708005e-16 NaN - 1.6551233510857692e-15
Kepler-kepler1 1.78110800586631019e-15 NaN - 2.251660583355296e-14
Kepler-kepler2 1.75172248822721899e-15 NaN - 1.3851842008333301e-14
Octave-jcobi1 8.10333571256565987e-12 - - -
Octave-jcobi2 3.04677350431218991e-13 - - -
Octave-jcobi3 2.69839951953865482e-11 - - -
Octave-jcobi4 3.04334859438206717e-14 - - -
Physics-linearOptics 3.33461283049173566e-11 - - -
Physics-linearOptics2 9.55453965834530331e-16 - - -
Physics-linearOptics3 1.70635245003665506e-15 - - -
Physics-quantumWalk 4.06370756402588081e-15 - - -
Physics-superFluidityEqn13 6.47748277987145913e-13 - - -
Physics-superFluidityEqn7 5.93806306559339757e-10 - - -
Physics-teaWhistle1 2.86450087501452372e-16 - - -
Physics-teaWhistle2 5.85432901842385149e-13 - - -
Physics-teaWhistle3 0e+00 - - -
Physics-teaWhistle4 1.12548865362631236e-05 - - -
Product-product8 5.53008447874673893e-16 NaN NaN -
RigidBody-rigidBody1 7.04423875649623992e-11 NaN NaN -
RigidBody-rigidBody2 1.79634323047412135e-11 NaN NaN -
Science-carbonGas 3.63906380260309128e-16 9.193103103352256E-15 3.183327768209126E-15 1.174190688550639e-15
Science-predatorPrey 3.11954805622830146e-16 3.632950480006059E-15 3.632950480006059E-15 5.359026681315161e-16
Science-verhulst 2.18964266610234866e-16 1.1210577091515035E-15 8.17282915970509E-16 3.8140190705988247e-16
Sum-sum8 4.76936954653274006e-12 NaN NaN -
Traincar1-out1 3.16119594496601531e-10 NaN NaN -
Traincar1-state1 6.02764245555319953e-11 NaN NaN -
Traincar1-state2 5.45895198278504929e-16 NaN NaN -
Traincar1-state3 2.43549526380912606e-13 NaN NaN -
Traincar2-out1 1.51486181559878987e-10 NaN NaN -
Traincar2-state1 9.70680671328231223e-14 NaN NaN -
Traincar2-state2 2.16262863496803168e-13 NaN NaN -
Traincar2-state3 1.48764783241959277e-15 NaN NaN -
Traincar2-state4 1.38778487006485917e-15 NaN NaN -
Traincar2-state5 4.33504962038082766e-12 NaN NaN -
Traincar3-out1 1.59731779919569003e-11 NaN NaN -
Traincar3-state1 1.19715241952726207e-12 NaN NaN -
Traincar3-state2 6.45414893043750108e-13 NaN NaN -
Traincar3-state3 1.11310502424229967e-11 NaN NaN -
Traincar3-state4 7.44408835300543789e-14 NaN NaN -
Traincar3-state5 6.17232596399854624e-14 NaN NaN -
Traincar3-state6 2.44420191227970646e-13 NaN NaN -
Traincar3-state7 5.58482647898669768e-14 NaN NaN -
Traincar4-out1 1.00330928425940219e-10 NaN NaN -
Traincar4-state1 4.45083601010282248e-14 NaN NaN -
Traincar4-state2 8.04862722384862520e-15 NaN NaN -
Traincar4-state3 1.06437987584682051e-14 NaN NaN -
Traincar4-state4 4.89134369732490521e-13 NaN NaN -
Traincar4-state5 8.16077304750791876e-13 NaN NaN -
Traincar4-state6 1.93122172990092287e-15 NaN NaN -
Traincar4-state7 5.80026190251295909e-15 NaN NaN -
Traincar4-state8 4.08278865559089472e-15 NaN NaN -
Traincar4-state9 6.01769477640001326e-15 NaN NaN -
Turbine-turbine1 4.60882314800701153e-16 3.897844097521321E-14 2.729325093675814E-14 1.6644115829132697e-15
Turbine-turbine2 1.21537146332236114e-10 NaN NaN -
Turbine-turbine3 7.46441458465594246e-16 1.0133506377966313E-13 6.973430305592687E-14 5.13280559199651e-15
UnivariateEvenLonger-f0 5.29353617728624627e-16 1.3192572034803623E-13 1.6940644445335835E-14 2.233871224149125e-15
UnivariateEvenLonger-f1 1.66339185002846627e-16 - - 1.0036749209518803e-15
UnivariateEvenLonger-f2 1.38605183340811120e-16 NaN 8.26073193761899E-14 -
UnivariateEvenLonger-f3 2.79849711894569119e-16 8.227014869879802E-15 1.0140507369304407E-15 5.36320321311787e-16
UnivariateEvenLonger-f4 4.77771037909967563e-16 NaN 6.470571676331444E-14 -
UnivariateEvenLonger-f5 2.18444421505332504e-16 NaN 5.758064205502553E-14 2.523378331683749e-15
UnivariateEvenLonger-f6 5.11576168619207069e-16 - - 4.9511741508037193e-14
UnivariateEvenLonger-f7 2.51072960693228571e-16 NaN 2.1085479147736303E-15 1.2641623150648763e-15
UnivariateEvenLonger-f8 5.25791075084319071e-16 - 2.855854073894244E-11 1.4942010295726542e-13
UnivariateEvenLonger-f9 1.10936053175534378e-16 - - -
UnivariateLonger-f0 5.72646114279913610e-16 NaN 1.4747738685319243E-15 1.6317512781857283e-15
UnivariateLonger-f1 2.35339789539201873e-16 2.4426728487370134E-4 8.673586666609968E-12 1.763818248701249e-11
UnivariateLonger-f2 2.41230901930982345e-16 8.881784197001252E-16 8.881784197001252E-16 2.8678670316439303e-16
UnivariateLonger-f3 2.21257250716687216e-16 3.1086244689504383E-15 2.0747801572137844E-15 5.665965780845627e-16
UnivariateLonger-f4 2.22044604925031308e-16 - 1.1809028864923526E-11 -
UnivariateLonger-f5 2.15308947583862795e-16 5.220313977012981E-15 5.220313977012981E-15 4.440892098500626e-16
UnivariateLonger-f6 3.32043030054958153e-16 1.010549668636587E-13 1.010549668636587E-13 1.8750433304780422e-15
UnivariateLonger-f7 3.31070506089530081e-16 4.365574568510056E-11 4.365574568510056E-11 1.951216965778713e-14
UnivariateLonger-f8 7.50155528604389147e-16 NaN 1.982081907660413E-15 1.853005688787183e-15
UnivariateLonger-f9 3.79321201665875357e-16 5.37190589474141E-15 2.3413336745814815E-15 5.512413150728771e-16
UnivariateShort-f0 3.31070506089530081e-16 2.9103830456733704E-11 2.9103830456733704E-11 1.2573275753879898e-14
UnivariateShort-f1 5.39447584882688693e-16 9.313225746154787E-9 9.313225746154787E-9 8.845701948700935e-14
UnivariateShort-f2 1.93855118033006675e-16 6.631732200427602E-14 6.631732200427602E-14 1.4062824978585316e-15
UnivariateShort-f3 3.42795972531697772e-16 4.6566128730773926E-10 9.22009026683202E-12 2.969846590872294e-14
UnivariateShort-f4 1.57008688985462592e-16 8.185452315956382E-12 5.969904361475939E-13 5.689893001203929e-15
UnivariateShort-f5 1.57008688985462592e-16 9.094947017729282E-13 3.221861216842855E-14 2.220446049250313e-15
UnivariateShort-f6 0e+00 NaN 1.0794121670730035E-15 7.50573312422641e-16
UnivariateShort-f8 1.57007145244494047e-16 3.3072534609924664E-13 6.523106655234939E-14 4.284154730318251e-15
UnivariateShort-f9 2.95304256025650633e-16 3.552713678800501E-15 1.1861685057358047E-15 5.551115123125783e-16
\ No newline at end of file
//benchmark max abs error, max rel error
BatchReactor-out1 6.730727086790012e-16 NaN
BatchReactor-out2 2.005340338229189e-15 NaN
BatchReactor-state1 5.221517662690189e-16 NaN
BatchReactor-state2 4.0375688903360185e-16 NaN
BatchReactor-state3 5.464378949326942e-16 NaN
BatchReactor-state4 5.898195343592705e-16 NaN
Traincar1-out1 3.214495336578693e-12 NaN
Traincar1-state1 3.3501521869150342e-15 NaN
Traincar1-state2 5.918139242555575e-15 NaN
Traincar1-state3 5.021218765213428e-15 NaN
Traincar2-out1 1.9968471320908066e-12 NaN
Traincar2-state1 8.504698710362115e-15 NaN
Traincar2-state2 8.503289222308875e-15 NaN
Traincar2-state3 7.661673470546427e-15 NaN
Traincar2-state4 6.773236282306765e-15 NaN
Traincar2-state5 1.2990409834275336e-14 NaN
Traincar3-out1 3.5640823625726625e-11 NaN
Traincar3-state1 5.654874012186474e-15 NaN
Traincar3-state2 5.912764319229369e-15 NaN
Traincar3-state3 5.241684292937008e-15 NaN
Traincar3-state4 9.50155651044133e-15 NaN
Traincar3-state5 8.606264716321969e-15 NaN
Traincar3-state6 7.718862171563698e-15 NaN
Traincar3-state7 6.83044512866162e-15 NaN
Traincar4-out1 3.587956598494202e-10 NaN
Traincar4-state1 6.2178322689775715e-15 NaN
Traincar4-state2 6.661946567629203e-15 NaN
Traincar4-state3 6.217740288354612e-15 NaN
Traincar4-state4 5.773668914172917e-15 NaN
Traincar4-state5 1.141919023981192e-14 NaN
Traincar4-state6 1.0436405682874642e-14 NaN
Traincar4-state7 9.5482246655172e-15 NaN
Traincar4-state8 8.66020080346763e-15 NaN
Traincar4-state9 7.771961232127201e-15 NaN
Product-product8 3.68682862017522e-12 NaN
Sum-sum8 2.8421709430404007e-14 NaN
BetaDistribution-aParameter 3.6359892874315847e-10 NaN
BetaDistribution-bParameter 4.096722960866828e-13 NaN
Floudas-floudas26 5.839773109528323e-13 NaN
Floudas-floudas33 3.1796787425264483e-13 NaN
Floudas-floudas34 1.3322676295501878e-15 NaN
Floudas-floudas46 4.440892098500626e-16 NaN
Floudas-floudas47 1.1546319456101628e-14 NaN
Floudas-floudas1 3.339550858072471e-13 NaN
Himmilbeau-himmilbeau 1.5631940186722206e-12 NaN
Kepler-kepler0 8.012257524114829e-14 NaN
Kepler-kepler1 3.663707559553586e-13 NaN
Kepler-kepler2 2.0807206624340324e-12 NaN
Bsplines-bspline0 1.0639637319324417e-16 NaN
Bsplines-bspline1 5.181040781584064e-16 NaN
Bsplines-bspline2 5.181040781584064e-16 NaN
Bsplines-bspline3 5.088522196198634e-17 NaN
Doppler-doppler 3.7460851093122305e-13 1.2723419098246272E-11
RigidBody-rigidBody1 2.398081733190338e-13 NaN
RigidBody-rigidBody2 2.3170798613136867e-11 NaN
Science-verhulst 3.530139169243032e-16 1.1210577091515035E-15
Science-predatorPrey 1.354257102009066e-16 3.632950480006059E-15
Science-carbonGas 1.9281699025519574e-08 9.193103103352256E-15
Turbine-turbine1 6.04371864298553e-14 3.897844097521321E-14
Turbine-turbine2 8.410176828459292e-14 NaN
Turbine-turbine3 4.7231852167879186e-14 1.0133506377966313E-13
Physics-linearOptics2 0.0016698220424586907 NaN
Physics-linearOptics3 0.0016637449152767658 NaN
UnivariateShort-f0 8.881784197001252e-16 2.9103830456733704E-11
UnivariateShort-f1 5.551115123125784e-16 9.313225746154787E-9
UnivariateShort-f2 7.771561172376096e-16 6.631732200427602E-14
UnivariateShort-f3 7.105427357601002e-15 4.6566128730773926E-10
UnivariateShort-f4 1.5987211554602308e-14 8.185452315956382E-12
UnivariateShort-f5 3.552713678800501e-15 9.094947017729282E-13
UnivariateShort-f6 6.661338147750939e-16 NaN
UnivariateShort-f8 2.1316282072803006e-14 3.3072534609924664E-13
UnivariateShort-f9 3.552713678800501e-15 3.552713678800501E-15
UnivariateLonger-f0 5.865533753146579e-17 NaN
UnivariateLonger-f1 5.963556759611849e-08 2.4426728487370134E-4
UnivariateLonger-f2 7.771561172376096e-16 8.881784197001252E-16
UnivariateLonger-f3 6.217248937900877e-15 3.1086244689504383E-15
UnivariateLonger-f5 9.992007221626409e-16 5.220313977012981E-15
UnivariateLonger-f6 3.552713678800501e-15 1.010549668636587E-13
UnivariateLonger-f7 5.329070518200752e-15 4.365574568510056E-11
UnivariateLonger-f8 5.431852884152377e-17 NaN
UnivariateLonger-f9 2.1319751519754972e-14 5.37190589474141E-15
UnivariateEvenLonger-f0 3.752553823233031e-12 1.3192572034803623E-13
UnivariateEvenLonger-f2 1.1723955140041656e-13 NaN
UnivariateEvenLonger-f3 2.5508566613152706e-16 8.227014869879802E-15
UnivariateEvenLonger-f4 9.148237722911291e-14 NaN
UnivariateEvenLonger-f5 9.103828801926285e-15 NaN
UnivariateEvenLonger-f7 3.556183125752455e-16 NaN
//benchmark max abs error, max rel error
BatchReactor-out1 6.730727086790012e-16 NaN
BatchReactor-out2 2.005340338229189e-15 NaN
BatchReactor-state1 5.221517662690189e-16 NaN
BatchReactor-state2 4.0375688903360185e-16 NaN
BatchReactor-state3 5.464378949326942e-16 NaN
BatchReactor-state4 5.898195343592705e-16 NaN
Traincar1-out1 3.214495336578693e-12 NaN
Traincar1-state1 3.3501521869150342e-15 NaN
Traincar1-state2 5.918139242555575e-15 NaN
Traincar1-state3 5.021218765213428e-15 NaN
Traincar2-out1 1.9968471320908066e-12 NaN
Traincar2-state1 8.504698710362115e-15 NaN
Traincar2-state2 8.503289222308875e-15 NaN
Traincar2-state3 7.661673470546427e-15 NaN
Traincar2-state4 6.773236282306765e-15 NaN
Traincar2-state5 1.2990409834275336e-14 NaN
Traincar3-out1 3.5640823625726625e-11 NaN
Traincar3-state1 5.654874012186474e-15 NaN
Traincar3-state2 5.912764319229369e-15 NaN
Traincar3-state3 5.241684292937008e-15 NaN
Traincar3-state4 9.50155651044133e-15 NaN
Traincar3-state5 8.606264716321969e-15 NaN
Traincar3-state6 7.718862171563698e-15 NaN
Traincar3-state7 6.83044512866162e-15 NaN
Traincar4-out1 3.587956598494202e-10 NaN
Traincar4-state1 6.2178322689775715e-15 NaN
Traincar4-state2 6.661946567629203e-15 NaN
Traincar4-state3 6.217740288354612e-15 NaN
Traincar4-state4 5.773668914172917e-15 NaN
Traincar4-state5 1.141919023981192e-14 NaN
Traincar4-state6 1.0436405682874642e-14 NaN
Traincar4-state7 9.5482246655172e-15 NaN
Traincar4-state8 8.66020080346763e-15 NaN
Traincar4-state9 7.771961232127201e-15 NaN
Product-product8 3.68682862017522e-12 NaN
Sum-sum8 2.8421709430404007e-14 NaN
BetaDistribution-aParameter 3.6359892874315847e-10 NaN
BetaDistribution-bParameter 4.096722960866828e-13 NaN
Floudas-floudas26 5.626610288800293e-13 NaN
Floudas-floudas33 3.1796787425264483e-13 NaN
Floudas-floudas34 1.3322676295501878e-15 NaN
Floudas-floudas46 4.440892098500626e-16 NaN
Floudas-floudas47 1.1546319456101628e-14 NaN
Floudas-floudas1 3.339550858072471e-13 NaN
Himmilbeau-himmilbeau 5.897504706808833e-13 NaN
Bsplines-bspline0 1.0639637319324417e-16 NaN
Bsplines-bspline1 4.255854927729767e-16 2.5610159330040828E-15
Bsplines-bspline2 3.9320398788807626e-16 2.3592239273284576E-15
Bsplines-bspline3 5.088522196198634e-17 NaN
Doppler-doppler 3.7460851093122305e-13 1.2723419098246272E-11
RigidBody-rigidBody1 2.398081733190338e-13 NaN
RigidBody-rigidBody2 2.3170798613136867e-11 NaN
Science-verhulst 2.9750276569304536e-16 8.17282915970509E-16
Science-predatorPrey 1.354257102009066e-16 3.632950480006059E-15
Science-carbonGas 1.3693763577826702e-08 3.183327768209126E-15
Turbine-turbine1 5.421993749195443e-14 2.729325093675814E-14
Turbine-turbine2 6.811455672999066e-14 NaN
Turbine-turbine3 3.923824639057806e-14 6.973430305592687E-14
JetEngine-jetEngine 5.327000053330094e-09 NaN
Physics-linearOptics2 0.0016688683681422845 NaN
Physics-linearOptics3 0.0016637449152767658 NaN
UnivariateShort-f0 8.881784197001252e-16 2.9103830456733704E-11
UnivariateShort-f1 5.551115123125784e-16 9.313225746154787E-9
UnivariateShort-f2 7.771561172376096e-16 6.631732200427602E-14
UnivariateShort-f3 2.10983032260248e-15 9.22009026683202E-12
UnivariateShort-f4 1.515454428613344e-14 5.969904361475939E-13
UnivariateShort-f5 1.887379141862766e-15 3.221861216842855E-14
UnivariateShort-f6 6.661338147750939e-16 1.0794121670730035E-15
UnivariateShort-f8 7.771561172376096e-15 6.523106655234939E-14
UnivariateShort-f9 3.552713678800501e-15 1.1861685057358047E-15
UnivariateLonger-f0 4.824699667560495e-17 1.4747738685319243E-15
UnivariateLonger-f1 2.1642977431081015e-12 8.673586666609968E-12
UnivariateLonger-f2 7.771561172376096e-16 8.881784197001252E-16
UnivariateLonger-f3 6.217248937900877e-15 2.0747801572137844E-15
UnivariateLonger-f4 1.1726906912993155e-11 1.1809028864923526E-11
UnivariateLonger-f5 9.992007221626409e-16 5.220313977012981E-15
UnivariateLonger-f6 3.552713678800501e-15 1.010549668636587E-13
UnivariateLonger-f7 5.329070518200752e-15 4.365574568510056E-11
UnivariateLonger-f8 5.431852884152377e-17 1.982081907660413E-15
UnivariateLonger-f9 1.8655216260654596e-14 2.3413336745814815E-15
UnivariateEvenLonger-f0 2.1682987323412453e-12 1.6940644445335835E-14
UnivariateEvenLonger-f2 4.618831754523999e-14 8.26073193761899E-14
UnivariateEvenLonger-f3 2.134523027080837e-16 1.0140507369304407E-15
UnivariateEvenLonger-f4 4.0412794619706935e-14 6.470571676331444E-14
UnivariateEvenLonger-f5 7.113233613242899e-15 5.758064205502553E-14
UnivariateEvenLonger-f7 1.8676737673778423e-16 2.1085479147736303E-15
UnivariateEvenLonger-f8 5.56165288736423e-13 2.855854073894244E-11
//benchmark max abs error, max rel error
BatchReactor-out1 6.730727086790012e-16 -
BatchReactor-out2 2.005340338229189e-15 -
BatchReactor-state1 5.221517662690189e-16 -
BatchReactor-state3 5.464378949326942e-16 -
BatchReactor-state2 4.0375688903360185e-16 -
BatchReactor-state4 5.898195343592705e-16 -
time: 6850399 ms
Traincar1-out1 2.965805379062658e-12 -
Traincar1-state1 3.3501521869150342e-15 -
Traincar1-state2 5.918139242555575e-15 -
Traincar1-state3 5.021218765213428e-15 -
time: 816138 ms
Traincar2-out1 1.709743457922741e-12 -
Traincar2-state1 - - (out-of-memory)
Traincar2-state2 - - (out-of-memory)
Traincar2-state3 - - (out-of-memory)
Traincar2-state4 - - (out-of-memory)
Traincar2-state5 - - (out-of-memory)
time: 911850 ms
Traincar3-out1 - - (out-of-memory)
Traincar3-state1 - - (out-of-memory)
Traincar3-state2 - - (out-of-memory)
Traincar3-state3 - - (out-of-memory)
Traincar3-state4 - - (out-of-memory)
Traincar3-state5 - - (out-of-memory)
Traincar3-state6 - - (out-of-memory)
Traincar3-state7 - - (out-of-memory)
time: 1214942 ms
Traincar4-out1 - - (out-of-memory)
Traincar4-state1 - - (out-of-memory)
Traincar4-state2 - - (out-of-memory)
Traincar4-state3 - - (out-of-memory)
Traincar4-state4 - - (out-of-memory)
Traincar4-state5 - - (out-of-memory)
Traincar4-state6 - - (out-of-memory)
Traincar4-state7 - - (out-of-memory)
Traincar4-state8 - - (out-of-memory)
Traincar4-state8 - - (out-of-memory)
time: 1643787 ms
BetaDistribution-aParameter 3.6359892874315847e-10 -
BetaDistribution-bParameter 4.096722960866828e-13 -
time: 430 ms
Floudas-floudas47 1.1546319456101628e-14 -
Floudas-floudas1 3.339550858072471e-13 -
Floudas-floudas46 4.440892098500626e-16 -
Floudas-floudas34 1.3322676295501878e-15 -
Floudas-floudas33 3.1796787425264483e-13 -
Floudas-floudas26 - - (out-of-memory)
time: 8223346 ms
Himmilbeau-himmilbeau 5.897504706808833e-13 -
time: 446 ms
Kepler-kepler0 5.983302742151864e-14 1.6551233510857692e-15
Kepler-kepler1 2.1853860943110704e-13 2.251660583355296e-14
Kepler-kepler2 1.4631077682736305e-12 1.3851842008333301e-14
time: 10883067 ms
Bsplines-bspline0 1.0639637319324417e-16 -
Bsplines-bspline1 3.608224830031759e-16 1.1577191968016339e-14
Bsplines-bspline2 3.978299171573478e-16 7.626132597265452e-16
Bsplines-bspline3 5.088522196198634e-17 -
time: 248 ms
Doppler-doppler 1.2564142139033842e-13 1.4494007244151482e-13
time: 17835 ms
RigidBody-rigidBody1 2.398081733190338e-13 -
RigidBody-rigidBody2 2.3170798613136867e-11 -
time: 1738 ms
Science-verhulst 2.5036761764889345e-16 3.8140190705988247e-16
Science-predatorPrey 1.2747600141453324e-16 5.359026681315161e-16
Science-carbonGas 6.871945265993286e-09 1.174190688550639e-15
time: 3888719 ms
Turbine-turbine1 1.7892256970774354e-14 1.6644115829132697e-15
Turbine-turbine2 1.5842865025948352e-14 -
Turbine-turbine3 9.716895626166913e-15 5.13280559199651e-15
time: 23307 ms
JetEngine-jetEngine 2.6333979441517408e-11 -
time: 8624 ms
Physics-linearOptics2 0.0016698215767974034 -
Physics-linearOptics3 0.0016637449152767658 -
Physics-quantumWalk - - (neg-sqrt)
Physics-teaWhistle3 - - (neg-sqrt)
Physics-superFluidityEqn13 - - (neg-sqrt)
Physics-teaWhistle1 - - (neg-sqrt)
Physics-superFluidityEqn7 - - (neg-sqrt)
Physics-linearOptics - - (div-by-zero)
Physics-teaWhistle2 - - (neg-sqrt)
Physics-teaWhistle4 - - (neg-sqrt)
time: 3441 ms
UnivariateShort-f0 8.881784197001252e-16 1.2573275753879898e-14
UnivariateShort-f5 2.335296706970157e-16 2.220446049250313e-15
UnivariateShort-f8 9.119963531003881e-16 4.284154730318251e-15
UnivariateShort-f3 4.670593413940314e-16 2.969846590872294e-14
UnivariateShort-f1 5.551115123125784e-16 8.845701948700935e-14
UnivariateShort-f6 6.661338147750939e-16 7.50573312422641e-16
UnivariateShort-f9 3.552713678800501e-15 5.551115123125783e-16
UnivariateShort-f4 1.843551074778872e-16 5.689893001203929e-15
UnivariateShort-f2 7.771561172376096e-16 1.4062824978585316e-15 exceptions: Map()
time: 472 ms
UnivariateLonger-f0 4.4777549723651333e-17 1.6317512781857283e-15
UnivariateLonger-f5 9.992007221626409e-16 4.440892098500626e-16
UnivariateLonger-f7 5.329070518200752e-15 1.951216965778713e-14
UnivariateLonger-f3 6.217248937900877e-15 5.665965780845627e-16
UnivariateLonger-f1 2.0473507333918533e-12 1.763818248701249e-11
UnivariateLonger-f6 3.552713678800501e-15 1.8750433304780422e-15
UnivariateLonger-f9 7.283930403279016e-15 5.512413150728771e-16
UnivariateLonger-f8 5.084908188957016e-17 1.853005688787183e-15
UnivariateLonger-f2 7.771561172376096e-16 2.8678670316439303e-16 exceptions: Map(f4 -> div-by-zero)
time: 458 ms
UnivariateEvenLonger-f0 1.46585219025164e-12 2.233871224149125e-15
UnivariateEvenLonger-f5 7.305267502033531e-15 2.523378331683749e-15
UnivariateEvenLonger-f7 1.847398102550191e-16 1.2641623150648763e-15
UnivariateEvenLonger-f3 1.868115632321407e-16 5.36320321311787e-16
UnivariateEvenLonger-f1 1.2983192636536467e-15 1.0036749209518803e-15
UnivariateEvenLonger-f6 1.665334536937735e-15 4.9511741508037193e-14
UnivariateEvenLonger-f9 1.0043285730083942e-15 -
UnivariateEvenLonger-f8 2.6063020734561265e-14 1.4942010295726542e-13
UnivariateEvenLonger-f4 8.309943296646378e-15 -
UnivariateEvenLonger-f2 9.903797721039754e-15 - exceptions: Map()
time: 1053 ms
/* Copyright 2015 EPFL, Lausanne */
// Original work Copyright 2009-2016 EPFL, Lausanne