Commit 8423994c authored by Eva Darulova's avatar Eva Darulova

Merge branch 'relative' into 'master'

Relative

See merge request !1
parents 8f53156d 739f73d4
# Project Daisy
Daisy is a framework for accuracy analysis of numerical programs whose aim
is to be modular and extensible. It is currently very much work in progress,
so stay tuned for updates and new features.
The current functionality includes:
- static analysis of roundoff errors in arithmetic expressions for various
floating-point and fixed-point precisions
- code generation of fixed-point arithmetic code from mathematical expressions
- dynamic analysis using rationals or arbitrary precision
## Documentation
To come soon.
## First steps
......@@ -80,7 +67,19 @@ Currently, this is
[install it first on your machine](https://github.com/Z3Prover/z3).
* MPFR: Daisy uses a [Java binding](https://github.com/kframework/mpfr-java).
(TODO: figure out whether we used the static or dynamic binding)
## Documentation
## Intellij Idea Setup
To run Daisy in Intellij Idea you first have to install Scala Plugin: Settings (Ctrl + Alt + S) -> Plugins. Choose Scala in the list and press "Install JetBrains Plugin ...". Then let Idea know where is your Scala (or make sure Scala SDK is already there): Project Structure -> Global Libraries -> New Global Library -> Scala SDK -> select the source folder for the SDk on your machine.
Also make sure the Java SDK is set up for Idea (Project Structure -> SDKs -> check that your JDK is here or add it here).
Choose File -> New -> Project from Existing Source -> choose the path to the build.sbt file
or
File -> New -> Project from Version Control -> Git -> put git-rts@gitlab.mpi-sws.org:AVA/daisy.git into the URL field and select the destination folder for source files to be copied.
After the setup run Daisy in the Terminal of Intellij Idea using sbt as described above.
Acknowledgements
----
......
absolute errors (dynamic intervals&AA smt&AA subdivAll&AA
BatchReactor-out1 4.30810942475545743e-16 6.730727086790012e-16 6.730727086790012e-16 6.730727086790012e-16
BatchReactor-out2 1.31024080474162474e-15 2.005340338229189e-15 2.005340338229189e-15 2.005340338229189e-15
BatchReactor-state1 4.17745171787942126e-16 5.221517662690189e-16 5.221517662690189e-16 5.221517662690189e-16
BatchReactor-state2 3.39464900633856814e-16 4.0375688903360185e-16 4.0375688903360185e-16 4.0375688903360185e-16
BatchReactor-state3 3.51702222900485139e-16 5.464378949326942e-16 5.464378949326942e-16 5.464378949326942e-16
BatchReactor-state4 4.49629222742942147e-16 5.898195343592705e-16 5.898195343592705e-16 5.898195343592705e-16
BetaDistribution-aParameter 1.58028618801244501e-10 3.6359892874315847e-10 3.6359892874315847e-10 3.6359892874315847e-10
BetaDistribution-bParameter 1.76201486324092191e-13 4.096722960866828e-13 4.096722960866828e-13 4.096722960866828e-13
Bsplines-bspline0 2.74675031982032091e-17 1.0639637319324417e-16 1.0639637319324417e-16 1.0639637319324417e-16
Bsplines-bspline1 1.47791089628745422e-16 5.181040781584064e-16 4.255854927729767e-16 3.608224830031759e-16
Bsplines-bspline2 1.41439862880906006e-16 5.181040781584064e-16 3.9320398788807626e-16 3.978299171573478e-16
Bsplines-bspline3 2.73170682411068242e-17 5.088522196198634e-17 5.088522196198634e-17 5.088522196198634e-17
Doppler-doppler 6.59432499828512494e-14 3.7460851093122305e-13 3.7460851093122305e-13 1.2564142139033842e-13
Floudas-floudas1 1.67881180044192041e-13 3.339550858072471e-13 3.339550858072471e-13 3.339550858072471e-13
Floudas-floudas26 1.79816016486124102e-13 5.839773109528323e-13 5.626610288800293e-13 -
Floudas-floudas33 1.66257848574834948e-13 3.1796787425264483e-13 3.1796787425264483e-13 3.1796787425264483e-13
Floudas-floudas34 6.66133814775093924e-16 1.3322676295501878e-15 1.3322676295501878e-15 1.3322676295501878e-15
Floudas-floudas46 4.44089209850062616e-16 4.440892098500626e-16 4.440892098500626e-16 4.440892098500626e-16
Floudas-floudas47 1.10547437245066556e-14 1.1546319456101628e-14 1.1546319456101628e-14 1.1546319456101628e-14
Himmilbeau-himmilbeau 2.87853330804370017e-13 1.5631940186722206e-12 5.897504706808833e-13 5.897504706808833e-13
JetEngine-jetEngine 4.33886755524488512e-12 - 5.327000053330094e-09 2.6333979441517408e-11
Kepler-kepler0 3.51637777195018777e-14 8.012257524114829e-14 - 5.983302742151864e-14
Kepler-kepler1 9.66238015932647770e-14 3.663707559553586e-13 - 2.1853860943110704e-13
Kepler-kepler2 5.24232013276063837e-13 2.0807206624340324e-12 - 1.4631077682736305e-12
Octave-jcobi1 4.77171513830522008e-15 - - -
Octave-jcobi2 2.62546636761320421e-13 - - -
Octave-jcobi3 5.07614013607969122e-13 - - -
Octave-jcobi4 2.02373875532033877e-13 - - -
Physics-linearOptics 9.84034380102329843e-07 - - -
Physics-linearOptics2 1.19802519113322151e-03 0.0016698220424586907 0.0016688683681422845 0.0016698215767974034
Physics-linearOptics3 1.20885261343469392e-03 0.0016637449152767658 0.0016637449152767658 0.0016637449152767658
Physics-quantumWalk 1.15092407706237163e-16 - - -
Physics-superFluidityEqn13 3.84919409355732962e-06 - - -
Physics-superFluidityEqn7 1.17807322293061605e-07 - - -
Physics-teaWhistle1 1.23523479659870831e-11 - - -
Physics-teaWhistle2 2.82157537828210842e-06 - - -
Physics-teaWhistle3 0e+00 - - -
Physics-teaWhistle4 4.11580020613304225e-04 - - -
Product-product8 6.93167072265658543e-13 3.68682862017522e-12 3.68682862017522e-12 -
RigidBody-rigidBody1 1.82255776513383471e-13 2.398081733190338e-13 2.398081733190338e-13 2.398081733190338e-13
RigidBody-rigidBody2 1.71057133584730592e-11 2.3170798613136867e-11 2.3170798613136867e-11 2.3170798613136867e-11
Science-carbonGas 3.26741526774013429e-09 1.9281699025519574e-08 1.3693763577826702e-08 6.871945265993286e-09
Science-predatorPrey 8.84890266518559898e-17 1.354257102009066e-16 1.354257102009066e-16 1.2747600141453324e-16
Science-verhulst 1.56970750122585468e-16 3.530139169243032e-16 2.9750276569304536e-16 2.5036761764889345e-16
Sum-sum8 1.68753899743023794e-14 2.8421709430404007e-14 2.8421709430404007e-14 -
Traincar1-out1 2.06613895029477134e-12 3.214495336578693e-12 3.214495336578693e-12 2.965805379062658e-12
Traincar1-state1 2.13182679149083056e-15 3.3501521869150342e-15 3.3501521869150342e-15 3.3501521869150342e-15
Traincar1-state2 4.56275132751377491e-15 5.918139242555575e-15 5.918139242555575e-15 5.918139242555575e-15
Traincar1-state3 4.47578951191531856e-15 5.021218765213428e-15 5.021218765213428e-15 5.021218765213428e-15
Traincar2-out1 9.06017885622631260e-13 1.9968471320908066e-12 1.9968471320908066e-12 1.709743457922741e-12
Traincar2-state1 6.25922152079722635e-15 8.504698710362115e-15 8.504698710362115e-15 -
Traincar2-state2 5.82881431801375824e-15 8.503289222308875e-15 8.503289222308875e-15 -
Traincar2-state3 5.31597316759104618e-15 7.661673470546427e-15 7.661673470546427e-15 -
Traincar2-state4 6.09544763199194055e-15 6.773236282306765e-15 6.773236282306765e-15 -
Traincar2-state5 9.00104688161795346e-15 1.2990409834275336e-14 1.2990409834275336e-14 -
Traincar3-out1 1.26348921800808350e-11 3.5640823625726625e-11 3.5640823625726625e-11 -
Traincar3-state1 3.71758129539108646e-15 5.654874012186474e-15 5.654874012186474e-15 -
Traincar3-state2 3.69958068137793260e-15 5.912764319229369e-15 5.912764319229369e-15 -
Traincar3-state3 3.89240317216905590e-15 5.241684292937008e-15 5.241684292937008e-15 -
Traincar3-state4 7.65630103670528948e-15 9.50155651044133e-15 9.50155651044133e-15 -
Traincar3-state5 7.00838258026988150e-15 8.606264716321969e-15 8.606264716321969e-15 -
Traincar3-state6 5.39450502914437643e-15 7.718862171563698e-15 7.718862171563698e-15 -
Traincar3-state7 4.82772481403246871e-15 6.83044512866162e-15 6.83044512866162e-15 -
Traincar4-out1 1.35877862108124356e-10 3.587956598494202e-10 3.587956598494202e-10 -
Traincar4-state1 4.27804044103960323e-15 6.2178322689775715e-15 6.2178322689775715e-15 -
Traincar4-state2 4.04382313720281087e-15 6.661946567629203e-15 6.661946567629203e-15 -
Traincar4-state3 3.91129971298554487e-15 6.217740288354612e-15 6.217740288354612e-15 -
Traincar4-state4 3.96419752886513753e-15 5.773668914172917e-15 5.773668914172917e-15 -
Traincar4-state5 7.45616192268521844e-15 1.141919023981192e-14 1.141919023981192e-14 -
Traincar4-state6 7.62144941921421183e-15 1.0436405682874642e-14 1.0436405682874642e-14 -
Traincar4-state7 7.13566705015584382e-15 9.5482246655172e-15 9.5482246655172e-15 -
Traincar4-state8 6.29560403438896365e-15 8.66020080346763e-15 8.66020080346763e-15 -
Traincar4-state9 5.97330061504762554e-15 7.771961232127201e-15 7.771961232127201e-15 -
Turbine-turbine1 5.50800852880808746e-15 6.04371864298553e-14 5.421993749195443e-14 1.7892256970774354e-14
Turbine-turbine2 7.38845967265856649e-15 8.410176828459292e-14 6.811455672999066e-14 1.5842865025948352e-14
Turbine-turbine3 3.63747943939461030e-15 4.7231852167879186e-14 3.923824639057806e-14 9.716895626166913e-15
UnivariateEvenLonger-f0 5.98577424917690090e-13 3.752553823233031e-12 2.1682987323412453e-12 1.46585219025164e-12
UnivariateEvenLonger-f1 3.33066113860200901e-16 - - 1.2983192636536467e-15
UnivariateEvenLonger-f2 6.66132764727777398e-16 1.1723955140041656e-13 4.618831754523999e-14 9.903797721039754e-15
UnivariateEvenLonger-f3 9.24622716665814000e-17 2.5508566613152706e-16 2.134523027080837e-16 1.868115632321407e-16
UnivariateEvenLonger-f4 2.22036917386365452e-15 9.148237722911291e-14 4.0412794619706935e-14 8.309943296646378e-15
UnivariateEvenLonger-f5 8.78054721915979480e-16 9.103828801926285e-15 7.113233613242899e-15 7.305267502033531e-15
UnivariateEvenLonger-f6 9.84550981252363386e-16 - - 1.665334536937735e-15
UnivariateEvenLonger-f7 3.30324011874627554e-17 3.556183125752455e-16 1.8676737673778423e-16 1.847398102550191e-16
UnivariateEvenLonger-f8 7.48642781405405111e-15 - 5.56165288736423e-13 2.6063020734561265e-14
UnivariateEvenLonger-f9 5.55108204483623473e-17 - - 1.0043285730083942e-15
UnivariateLonger-f0 1.94389020953887736e-17 5.865533753146579e-17 4.824699667560495e-17 4.4777549723651333e-17
UnivariateLonger-f1 1.31484393584434281e-15 5.963556759611849e-08 2.1642977431081015e-12 2.0473507333918533e-12
UnivariateLonger-f2 4.95385742768136663e-16 7.771561172376096e-16 7.771561172376096e-16 7.771561172376096e-16
UnivariateLonger-f3 1.77630588928761818e-15 6.217248937900877e-15 6.217248937900877e-15 6.217248937900877e-15
UnivariateLonger-f4 2.22044604925031308e-16 - 1.1726906912993155e-11 -
UnivariateLonger-f5 4.99590301022686568e-16 9.992007221626409e-16 9.992007221626409e-16 9.992007221626409e-16
UnivariateLonger-f6 2.21516143958162996e-15 3.552713678800501e-15 3.552713678800501e-15 3.552713678800501e-15
UnivariateLonger-f7 1.32444885482656506e-15 5.329070518200752e-15 5.329070518200752e-15 5.329070518200752e-15
UnivariateLonger-f8 2.54175214567126025e-17 5.431852884152377e-17 5.431852884152377e-17 5.084908188957016e-17
UnivariateLonger-f9 4.25109500067761467e-15 2.1319751519754972e-14 1.8655216260654596e-14 7.283930403279016e-15
UnivariateShort-f0 3.31112213706641267e-16 8.881784197001252e-16 8.881784197001252e-16 8.881784197001252e-16
UnivariateShort-f1 2.65722907731750894e-16 5.551115123125784e-16 5.551115123125784e-16 5.551115123125784e-16
UnivariateShort-f2 3.88571990454081866e-16 7.771561172376096e-16 7.771561172376096e-16 7.771561172376096e-16
UnivariateShort-f3 2.17094399123003981e-16 7.105427357601002e-15 2.10983032260248e-15 4.670593413940314e-16
UnivariateShort-f4 5.55111512312578270e-17 1.5987211554602308e-14 1.515454428613344e-14 1.843551074778872e-16
UnivariateShort-f5 1.11022302462515654e-16 3.552713678800501e-15 1.887379141862766e-15 2.335296706970157e-16
UnivariateShort-f6 0e+00 6.661338147750939e-16 6.661338147750939e-16 6.661338147750939e-16
UnivariateShort-f8 4.44089209850062616e-16 2.1316282072803006e-14 7.771561172376096e-15 9.119963531003881e-16
UnivariateShort-f9 8.88177815208773386e-16 3.552713678800501e-15 3.552713678800501e-15 3.552713678800501e-15
relative errors dynamic intervals&AA smt&AA subdivAll&AA
BatchReactor-out1 1.54529598732275609e-10 NaN NaN -
BatchReactor-out2 2.63528748087610845e-10 NaN NaN -
BatchReactor-state1 9.10726565782358207e-12 NaN NaN -
BatchReactor-state2 1.81269314637773540e-12 NaN NaN -
BatchReactor-state3 4.22746911910847322e-11 NaN NaN -
BatchReactor-state4 3.83412069570762673e-12 NaN NaN -
BetaDistribution-aParameter 6.39639881964809984e-11 NaN NaN -
BetaDistribution-bParameter 3.10618065353862184e-16 NaN NaN -
Bsplines-bspline0 2.74384318137096469e-16 NaN NaN -
Bsplines-bspline1 7.15732773921734855e-16 NaN 2.5610159330040828E-15 1.1577191968016339e-14
Bsplines-bspline2 2.54322228221909569e-16 NaN 2.3592239273284576E-15 7.626132597265452e-16
Bsplines-bspline3 2.76321560521310465e-16 NaN NaN -
Doppler-doppler 7.05861472638061530e-16 1.2723419098246272E-11 1.2723419098246272E-11 1.4494007244151482e-13
Floudas-floudas1 5.45634781050316617e-16 NaN NaN -
Floudas-floudas26 1.83719197814486664e-12 NaN NaN -
Floudas-floudas33 6.04013250415394411e-16 NaN NaN -
Floudas-floudas34 2.18948457656550688e-16 NaN NaN -
Floudas-floudas46 1.11022191432642766e-16 NaN NaN -
Floudas-floudas47 4.23533405603622239e-16 NaN NaN -
Himmilbeau-himmilbeau 7.18609916333463484e-14 NaN NaN -
JetEngine-jetEngine 1.32219077808522476e-10 - NaN -
Kepler-kepler0 5.35034988364708005e-16 NaN - 1.6551233510857692e-15
Kepler-kepler1 1.78110800586631019e-15 NaN - 2.251660583355296e-14
Kepler-kepler2 1.75172248822721899e-15 NaN - 1.3851842008333301e-14
Octave-jcobi1 8.10333571256565987e-12 - - -
Octave-jcobi2 3.04677350431218991e-13 - - -
Octave-jcobi3 2.69839951953865482e-11 - - -
Octave-jcobi4 3.04334859438206717e-14 - - -
Physics-linearOptics 3.33461283049173566e-11 - - -
Physics-linearOptics2 9.55453965834530331e-16 - - -
Physics-linearOptics3 1.70635245003665506e-15 - - -
Physics-quantumWalk 4.06370756402588081e-15 - - -
Physics-superFluidityEqn13 6.47748277987145913e-13 - - -
Physics-superFluidityEqn7 5.93806306559339757e-10 - - -
Physics-teaWhistle1 2.86450087501452372e-16 - - -
Physics-teaWhistle2 5.85432901842385149e-13 - - -
Physics-teaWhistle3 0e+00 - - -
Physics-teaWhistle4 1.12548865362631236e-05 - - -
Product-product8 5.53008447874673893e-16 NaN NaN -
RigidBody-rigidBody1 7.04423875649623992e-11 NaN NaN -
RigidBody-rigidBody2 1.79634323047412135e-11 NaN NaN -
Science-carbonGas 3.63906380260309128e-16 9.193103103352256E-15 3.183327768209126E-15 1.174190688550639e-15
Science-predatorPrey 3.11954805622830146e-16 3.632950480006059E-15 3.632950480006059E-15 5.359026681315161e-16
Science-verhulst 2.18964266610234866e-16 1.1210577091515035E-15 8.17282915970509E-16 3.8140190705988247e-16
Sum-sum8 4.76936954653274006e-12 NaN NaN -
Traincar1-out1 3.16119594496601531e-10 NaN NaN -
Traincar1-state1 6.02764245555319953e-11 NaN NaN -
Traincar1-state2 5.45895198278504929e-16 NaN NaN -
Traincar1-state3 2.43549526380912606e-13 NaN NaN -
Traincar2-out1 1.51486181559878987e-10 NaN NaN -
Traincar2-state1 9.70680671328231223e-14 NaN NaN -
Traincar2-state2 2.16262863496803168e-13 NaN NaN -
Traincar2-state3 1.48764783241959277e-15 NaN NaN -
Traincar2-state4 1.38778487006485917e-15 NaN NaN -
Traincar2-state5 4.33504962038082766e-12 NaN NaN -
Traincar3-out1 1.59731779919569003e-11 NaN NaN -
Traincar3-state1 1.19715241952726207e-12 NaN NaN -
Traincar3-state2 6.45414893043750108e-13 NaN NaN -
Traincar3-state3 1.11310502424229967e-11 NaN NaN -
Traincar3-state4 7.44408835300543789e-14 NaN NaN -
Traincar3-state5 6.17232596399854624e-14 NaN NaN -
Traincar3-state6 2.44420191227970646e-13 NaN NaN -
Traincar3-state7 5.58482647898669768e-14 NaN NaN -
Traincar4-out1 1.00330928425940219e-10 NaN NaN -
Traincar4-state1 4.45083601010282248e-14 NaN NaN -
Traincar4-state2 8.04862722384862520e-15 NaN NaN -
Traincar4-state3 1.06437987584682051e-14 NaN NaN -
Traincar4-state4 4.89134369732490521e-13 NaN NaN -
Traincar4-state5 8.16077304750791876e-13 NaN NaN -
Traincar4-state6 1.93122172990092287e-15 NaN NaN -
Traincar4-state7 5.80026190251295909e-15 NaN NaN -
Traincar4-state8 4.08278865559089472e-15 NaN NaN -
Traincar4-state9 6.01769477640001326e-15 NaN NaN -
Turbine-turbine1 4.60882314800701153e-16 3.897844097521321E-14 2.729325093675814E-14 1.6644115829132697e-15
Turbine-turbine2 1.21537146332236114e-10 NaN NaN -
Turbine-turbine3 7.46441458465594246e-16 1.0133506377966313E-13 6.973430305592687E-14 5.13280559199651e-15
UnivariateEvenLonger-f0 5.29353617728624627e-16 1.3192572034803623E-13 1.6940644445335835E-14 2.233871224149125e-15
UnivariateEvenLonger-f1 1.66339185002846627e-16 - - 1.0036749209518803e-15
UnivariateEvenLonger-f2 1.38605183340811120e-16 NaN 8.26073193761899E-14 -
UnivariateEvenLonger-f3 2.79849711894569119e-16 8.227014869879802E-15 1.0140507369304407E-15 5.36320321311787e-16
UnivariateEvenLonger-f4 4.77771037909967563e-16 NaN 6.470571676331444E-14 -
UnivariateEvenLonger-f5 2.18444421505332504e-16 NaN 5.758064205502553E-14 2.523378331683749e-15
UnivariateEvenLonger-f6 5.11576168619207069e-16 - - 4.9511741508037193e-14
UnivariateEvenLonger-f7 2.51072960693228571e-16 NaN 2.1085479147736303E-15 1.2641623150648763e-15
UnivariateEvenLonger-f8 5.25791075084319071e-16 - 2.855854073894244E-11 1.4942010295726542e-13
UnivariateEvenLonger-f9 1.10936053175534378e-16 - - -
UnivariateLonger-f0 5.72646114279913610e-16 NaN 1.4747738685319243E-15 1.6317512781857283e-15
UnivariateLonger-f1 2.35339789539201873e-16 2.4426728487370134E-4 8.673586666609968E-12 1.763818248701249e-11
UnivariateLonger-f2 2.41230901930982345e-16 8.881784197001252E-16 8.881784197001252E-16 2.8678670316439303e-16
UnivariateLonger-f3 2.21257250716687216e-16 3.1086244689504383E-15 2.0747801572137844E-15 5.665965780845627e-16
UnivariateLonger-f4 2.22044604925031308e-16 - 1.1809028864923526E-11 -
UnivariateLonger-f5 2.15308947583862795e-16 5.220313977012981E-15 5.220313977012981E-15 4.440892098500626e-16
UnivariateLonger-f6 3.32043030054958153e-16 1.010549668636587E-13 1.010549668636587E-13 1.8750433304780422e-15
UnivariateLonger-f7 3.31070506089530081e-16 4.365574568510056E-11 4.365574568510056E-11 1.951216965778713e-14
UnivariateLonger-f8 7.50155528604389147e-16 NaN 1.982081907660413E-15 1.853005688787183e-15
UnivariateLonger-f9 3.79321201665875357e-16 5.37190589474141E-15 2.3413336745814815E-15 5.512413150728771e-16
UnivariateShort-f0 3.31070506089530081e-16 2.9103830456733704E-11 2.9103830456733704E-11 1.2573275753879898e-14
UnivariateShort-f1 5.39447584882688693e-16 9.313225746154787E-9 9.313225746154787E-9 8.845701948700935e-14
UnivariateShort-f2 1.93855118033006675e-16 6.631732200427602E-14 6.631732200427602E-14 1.4062824978585316e-15
UnivariateShort-f3 3.42795972531697772e-16 4.6566128730773926E-10 9.22009026683202E-12 2.969846590872294e-14
UnivariateShort-f4 1.57008688985462592e-16 8.185452315956382E-12 5.969904361475939E-13 5.689893001203929e-15
UnivariateShort-f5 1.57008688985462592e-16 9.094947017729282E-13 3.221861216842855E-14 2.220446049250313e-15
UnivariateShort-f6 0e+00 NaN 1.0794121670730035E-15 7.50573312422641e-16
UnivariateShort-f8 1.57007145244494047e-16 3.3072534609924664E-13 6.523106655234939E-14 4.284154730318251e-15
UnivariateShort-f9 2.95304256025650633e-16 3.552713678800501E-15 1.1861685057358047E-15 5.551115123125783e-16
\ No newline at end of file
//benchmark max abs error, max rel error
BatchReactor-out1 6.730727086790012e-16 NaN
BatchReactor-out2 2.005340338229189e-15 NaN
BatchReactor-state1 5.221517662690189e-16 NaN
BatchReactor-state2 4.0375688903360185e-16 NaN
BatchReactor-state3 5.464378949326942e-16 NaN
BatchReactor-state4 5.898195343592705e-16 NaN
Traincar1-out1 3.214495336578693e-12 NaN
Traincar1-state1 3.3501521869150342e-15 NaN
Traincar1-state2 5.918139242555575e-15 NaN
Traincar1-state3 5.021218765213428e-15 NaN
Traincar2-out1 1.9968471320908066e-12 NaN
Traincar2-state1 8.504698710362115e-15 NaN
Traincar2-state2 8.503289222308875e-15 NaN
Traincar2-state3 7.661673470546427e-15 NaN
Traincar2-state4 6.773236282306765e-15 NaN
Traincar2-state5 1.2990409834275336e-14 NaN
Traincar3-out1 3.5640823625726625e-11 NaN
Traincar3-state1 5.654874012186474e-15 NaN
Traincar3-state2 5.912764319229369e-15 NaN
Traincar3-state3 5.241684292937008e-15 NaN
Traincar3-state4 9.50155651044133e-15 NaN
Traincar3-state5 8.606264716321969e-15 NaN
Traincar3-state6 7.718862171563698e-15 NaN
Traincar3-state7 6.83044512866162e-15 NaN
Traincar4-out1 3.587956598494202e-10 NaN
Traincar4-state1 6.2178322689775715e-15 NaN
Traincar4-state2 6.661946567629203e-15 NaN
Traincar4-state3 6.217740288354612e-15 NaN
Traincar4-state4 5.773668914172917e-15 NaN
Traincar4-state5 1.141919023981192e-14 NaN
Traincar4-state6 1.0436405682874642e-14 NaN
Traincar4-state7 9.5482246655172e-15 NaN
Traincar4-state8 8.66020080346763e-15 NaN
Traincar4-state9 7.771961232127201e-15 NaN
Product-product8 3.68682862017522e-12 NaN
Sum-sum8 2.8421709430404007e-14 NaN
BetaDistribution-aParameter 3.6359892874315847e-10 NaN
BetaDistribution-bParameter 4.096722960866828e-13 NaN
Floudas-floudas26 5.839773109528323e-13 NaN
Floudas-floudas33 3.1796787425264483e-13 NaN
Floudas-floudas34 1.3322676295501878e-15 NaN
Floudas-floudas46 4.440892098500626e-16 NaN
Floudas-floudas47 1.1546319456101628e-14 NaN
Floudas-floudas1 3.339550858072471e-13 NaN
Himmilbeau-himmilbeau 1.5631940186722206e-12 NaN
Kepler-kepler0 8.012257524114829e-14 NaN
Kepler-kepler1 3.663707559553586e-13 NaN
Kepler-kepler2 2.0807206624340324e-12 NaN
Bsplines-bspline0 1.0639637319324417e-16 NaN
Bsplines-bspline1 5.181040781584064e-16 NaN
Bsplines-bspline2 5.181040781584064e-16 NaN
Bsplines-bspline3 5.088522196198634e-17 NaN
Doppler-doppler 3.7460851093122305e-13 1.2723419098246272E-11
RigidBody-rigidBody1 2.398081733190338e-13 NaN
RigidBody-rigidBody2 2.3170798613136867e-11 NaN
Science-verhulst 3.530139169243032e-16 1.1210577091515035E-15
Science-predatorPrey 1.354257102009066e-16 3.632950480006059E-15
Science-carbonGas 1.9281699025519574e-08 9.193103103352256E-15
Turbine-turbine1 6.04371864298553e-14 3.897844097521321E-14
Turbine-turbine2 8.410176828459292e-14 NaN
Turbine-turbine3 4.7231852167879186e-14 1.0133506377966313E-13
Physics-linearOptics2 0.0016698220424586907 NaN
Physics-linearOptics3 0.0016637449152767658 NaN
UnivariateShort-f0 8.881784197001252e-16 2.9103830456733704E-11
UnivariateShort-f1 5.551115123125784e-16 9.313225746154787E-9
UnivariateShort-f2 7.771561172376096e-16 6.631732200427602E-14
UnivariateShort-f3 7.105427357601002e-15 4.6566128730773926E-10
UnivariateShort-f4 1.5987211554602308e-14 8.185452315956382E-12
UnivariateShort-f5 3.552713678800501e-15 9.094947017729282E-13
UnivariateShort-f6 6.661338147750939e-16 NaN
UnivariateShort-f8 2.1316282072803006e-14 3.3072534609924664E-13
UnivariateShort-f9 3.552713678800501e-15 3.552713678800501E-15
UnivariateLonger-f0 5.865533753146579e-17 NaN
UnivariateLonger-f1 5.963556759611849e-08 2.4426728487370134E-4
UnivariateLonger-f2 7.771561172376096e-16 8.881784197001252E-16
UnivariateLonger-f3 6.217248937900877e-15 3.1086244689504383E-15
UnivariateLonger-f5 9.992007221626409e-16 5.220313977012981E-15
UnivariateLonger-f6 3.552713678800501e-15 1.010549668636587E-13
UnivariateLonger-f7 5.329070518200752e-15 4.365574568510056E-11
UnivariateLonger-f8 5.431852884152377e-17 NaN
UnivariateLonger-f9 2.1319751519754972e-14 5.37190589474141E-15
UnivariateEvenLonger-f0 3.752553823233031e-12 1.3192572034803623E-13
UnivariateEvenLonger-f2 1.1723955140041656e-13 NaN
UnivariateEvenLonger-f3 2.5508566613152706e-16 8.227014869879802E-15
UnivariateEvenLonger-f4 9.148237722911291e-14 NaN
UnivariateEvenLonger-f5 9.103828801926285e-15 NaN
UnivariateEvenLonger-f7 3.556183125752455e-16 NaN
//benchmark max abs error, max rel error
BatchReactor-out1 6.730727086790012e-16 NaN
BatchReactor-out2 2.005340338229189e-15 NaN
BatchReactor-state1 5.221517662690189e-16 NaN
BatchReactor-state2 4.0375688903360185e-16 NaN
BatchReactor-state3 5.464378949326942e-16 NaN
BatchReactor-state4 5.898195343592705e-16 NaN
Traincar1-out1 3.214495336578693e-12 NaN
Traincar1-state1 3.3501521869150342e-15 NaN
Traincar1-state2 5.918139242555575e-15 NaN
Traincar1-state3 5.021218765213428e-15 NaN
Traincar2-out1 1.9968471320908066e-12 NaN
Traincar2-state1 8.504698710362115e-15 NaN
Traincar2-state2 8.503289222308875e-15 NaN
Traincar2-state3 7.661673470546427e-15 NaN
Traincar2-state4 6.773236282306765e-15 NaN
Traincar2-state5 1.2990409834275336e-14 NaN
Traincar3-out1 3.5640823625726625e-11 NaN
Traincar3-state1 5.654874012186474e-15 NaN
Traincar3-state2 5.912764319229369e-15 NaN
Traincar3-state3 5.241684292937008e-15 NaN
Traincar3-state4 9.50155651044133e-15 NaN
Traincar3-state5 8.606264716321969e-15 NaN
Traincar3-state6 7.718862171563698e-15 NaN
Traincar3-state7 6.83044512866162e-15 NaN
Traincar4-out1 3.587956598494202e-10 NaN
Traincar4-state1 6.2178322689775715e-15 NaN
Traincar4-state2 6.661946567629203e-15 NaN
Traincar4-state3 6.217740288354612e-15 NaN
Traincar4-state4 5.773668914172917e-15 NaN
Traincar4-state5 1.141919023981192e-14 NaN
Traincar4-state6 1.0436405682874642e-14 NaN
Traincar4-state7 9.5482246655172e-15 NaN
Traincar4-state8 8.66020080346763e-15 NaN
Traincar4-state9 7.771961232127201e-15 NaN
Product-product8 3.68682862017522e-12 NaN
Sum-sum8 2.8421709430404007e-14 NaN
BetaDistribution-aParameter 3.6359892874315847e-10 NaN
BetaDistribution-bParameter 4.096722960866828e-13 NaN
Floudas-floudas26 5.626610288800293e-13 NaN
Floudas-floudas33 3.1796787425264483e-13 NaN
Floudas-floudas34 1.3322676295501878e-15 NaN
Floudas-floudas46 4.440892098500626e-16 NaN
Floudas-floudas47 1.1546319456101628e-14 NaN
Floudas-floudas1 3.339550858072471e-13 NaN
Himmilbeau-himmilbeau 5.897504706808833e-13 NaN
Bsplines-bspline0 1.0639637319324417e-16 NaN
Bsplines-bspline1 4.255854927729767e-16 2.5610159330040828E-15
Bsplines-bspline2 3.9320398788807626e-16 2.3592239273284576E-15
Bsplines-bspline3 5.088522196198634e-17 NaN
Doppler-doppler 3.7460851093122305e-13 1.2723419098246272E-11
RigidBody-rigidBody1 2.398081733190338e-13 NaN
RigidBody-rigidBody2 2.3170798613136867e-11 NaN
Science-verhulst 2.9750276569304536e-16 8.17282915970509E-16
Science-predatorPrey 1.354257102009066e-16 3.632950480006059E-15
Science-carbonGas 1.3693763577826702e-08 3.183327768209126E-15
Turbine-turbine1 5.421993749195443e-14 2.729325093675814E-14
Turbine-turbine2 6.811455672999066e-14 NaN
Turbine-turbine3 3.923824639057806e-14 6.973430305592687E-14
JetEngine-jetEngine 5.327000053330094e-09 NaN
Physics-linearOptics2 0.0016688683681422845 NaN
Physics-linearOptics3 0.0016637449152767658 NaN
UnivariateShort-f0 8.881784197001252e-16 2.9103830456733704E-11
UnivariateShort-f1 5.551115123125784e-16 9.313225746154787E-9
UnivariateShort-f2 7.771561172376096e-16 6.631732200427602E-14
UnivariateShort-f3 2.10983032260248e-15 9.22009026683202E-12
UnivariateShort-f4 1.515454428613344e-14 5.969904361475939E-13
UnivariateShort-f5 1.887379141862766e-15 3.221861216842855E-14
UnivariateShort-f6 6.661338147750939e-16 1.0794121670730035E-15
UnivariateShort-f8 7.771561172376096e-15 6.523106655234939E-14
UnivariateShort-f9 3.552713678800501e-15 1.1861685057358047E-15
UnivariateLonger-f0 4.824699667560495e-17 1.4747738685319243E-15
UnivariateLonger-f1 2.1642977431081015e-12 8.673586666609968E-12
UnivariateLonger-f2 7.771561172376096e-16 8.881784197001252E-16
UnivariateLonger-f3 6.217248937900877e-15 2.0747801572137844E-15
UnivariateLonger-f4 1.1726906912993155e-11 1.1809028864923526E-11
UnivariateLonger-f5 9.992007221626409e-16 5.220313977012981E-15
UnivariateLonger-f6 3.552713678800501e-15 1.010549668636587E-13
UnivariateLonger-f7 5.329070518200752e-15 4.365574568510056E-11
UnivariateLonger-f8 5.431852884152377e-17 1.982081907660413E-15
UnivariateLonger-f9 1.8655216260654596e-14 2.3413336745814815E-15
UnivariateEvenLonger-f0 2.1682987323412453e-12 1.6940644445335835E-14
UnivariateEvenLonger-f2 4.618831754523999e-14 8.26073193761899E-14
UnivariateEvenLonger-f3 2.134523027080837e-16 1.0140507369304407E-15
UnivariateEvenLonger-f4 4.0412794619706935e-14 6.470571676331444E-14
UnivariateEvenLonger-f5 7.113233613242899e-15 5.758064205502553E-14
UnivariateEvenLonger-f7 1.8676737673778423e-16 2.1085479147736303E-15
UnivariateEvenLonger-f8 5.56165288736423e-13 2.855854073894244E-11
//benchmark max abs error, max rel error
BatchReactor-out1 6.730727086790012e-16 -
BatchReactor-out2 2.005340338229189e-15 -
BatchReactor-state1 5.221517662690189e-16 -
BatchReactor-state3 5.464378949326942e-16 -
BatchReactor-state2 4.0375688903360185e-16 -
BatchReactor-state4 5.898195343592705e-16 -
time: 6850399 ms
Traincar1-out1 2.965805379062658e-12 -
Traincar1-state1 3.3501521869150342e-15 -
Traincar1-state2 5.918139242555575e-15 -
Traincar1-state3 5.021218765213428e-15 -
time: 816138 ms
Traincar2-out1 1.709743457922741e-12 -
Traincar2-state1 - - (out-of-memory)
Traincar2-state2 - - (out-of-memory)
Traincar2-state3 - - (out-of-memory)
Traincar2-state4 - - (out-of-memory)
Traincar2-state5 - - (out-of-memory)
time: 911850 ms
Traincar3-out1 - - (out-of-memory)
Traincar3-state1 - - (out-of-memory)
Traincar3-state2 - - (out-of-memory)
Traincar3-state3 - - (out-of-memory)
Traincar3-state4 - - (out-of-memory)
Traincar3-state5 - - (out-of-memory)
Traincar3-state6 - - (out-of-memory)
Traincar3-state7 - - (out-of-memory)
time: 1214942 ms
Traincar4-out1 - - (out-of-memory)
Traincar4-state1 - - (out-of-memory)
Traincar4-state2 - - (out-of-memory)
Traincar4-state3 - - (out-of-memory)
Traincar4-state4 - - (out-of-memory)
Traincar4-state5 - - (out-of-memory)
Traincar4-state6 - - (out-of-memory)
Traincar4-state7 - - (out-of-memory)
Traincar4-state8 - - (out-of-memory)
Traincar4-state8 - - (out-of-memory)
time: 1643787 ms
BetaDistribution-aParameter 3.6359892874315847e-10 -
BetaDistribution-bParameter 4.096722960866828e-13 -
time: 430 ms
Floudas-floudas47 1.1546319456101628e-14 -
Floudas-floudas1 3.339550858072471e-13 -
Floudas-floudas46 4.440892098500626e-16 -
Floudas-floudas34 1.3322676295501878e-15 -
Floudas-floudas33 3.1796787425264483e-13 -
Floudas-floudas26 - - (out-of-memory)
time: 8223346 ms
Himmilbeau-himmilbeau 5.897504706808833e-13 -
time: 446 ms
Kepler-kepler0 5.983302742151864e-14 1.6551233510857692e-15
Kepler-kepler1 2.1853860943110704e-13 2.251660583355296e-14
Kepler-kepler2 1.4631077682736305e-12 1.3851842008333301e-14
time: 10883067 ms
Bsplines-bspline0 1.0639637319324417e-16 -
Bsplines-bspline1 3.608224830031759e-16 1.1577191968016339e-14
Bsplines-bspline2 3.978299171573478e-16 7.626132597265452e-16
Bsplines-bspline3 5.088522196198634e-17 -
time: 248 ms
Doppler-doppler 1.2564142139033842e-13 1.4494007244151482e-13
time: 17835 ms
RigidBody-rigidBody1 2.398081733190338e-13 -
RigidBody-rigidBody2 2.3170798613136867e-11 -
time: 1738 ms
Science-verhulst 2.5036761764889345e-16 3.8140190705988247e-16
Science-predatorPrey 1.2747600141453324e-16 5.359026681315161e-16
Science-carbonGas 6.871945265993286e-09 1.174190688550639e-15
time: 3888719 ms
Turbine-turbine1 1.7892256970774354e-14 1.6644115829132697e-15
Turbine-turbine2 1.5842865025948352e-14 -
Turbine-turbine3 9.716895626166913e-15 5.13280559199651e-15
time: 23307 ms
JetEngine-jetEngine 2.6333979441517408e-11 -
time: 8624 ms
Physics-linearOptics2 0.0016698215767974034 -
Physics-linearOptics3 0.0016637449152767658 -
Physics-quantumWalk - - (neg-sqrt)
Physics-teaWhistle3 - - (neg-sqrt)
Physics-superFluidityEqn13 - - (neg-sqrt)
Physics-teaWhistle1 - - (neg-sqrt)
Physics-superFluidityEqn7 - - (neg-sqrt)
Physics-linearOptics - - (div-by-zero)
Physics-teaWhistle2 - - (neg-sqrt)
Physics-teaWhistle4 - - (neg-sqrt)
time: 3441 ms
UnivariateShort-f0 8.881784197001252e-16 1.2573275753879898e-14
UnivariateShort-f5 2.335296706970157e-16 2.220446049250313e-15
UnivariateShort-f8 9.119963531003881e-16 4.284154730318251e-15
UnivariateShort-f3 4.670593413940314e-16 2.969846590872294e-14
UnivariateShort-f1 5.551115123125784e-16 8.845701948700935e-14
UnivariateShort-f6 6.661338147750939e-16 7.50573312422641e-16
UnivariateShort-f9 3.552713678800501e-15 5.551115123125783e-16
UnivariateShort-f4 1.843551074778872e-16 5.689893001203929e-15
UnivariateShort-f2 7.771561172376096e-16 1.4062824978585316e-15 exceptions: Map()
time: 472 ms
UnivariateLonger-f0 4.4777549723651333e-17 1.6317512781857283e-15
UnivariateLonger-f5 9.992007221626409e-16 4.440892098500626e-16
UnivariateLonger-f7 5.329070518200752e-15 1.951216965778713e-14
UnivariateLonger-f3 6.217248937900877e-15 5.665965780845627e-16
UnivariateLonger-f1 2.0473507333918533e-12 1.763818248701249e-11
UnivariateLonger-f6 3.552713678800501e-15 1.8750433304780422e-15
UnivariateLonger-f9 7.283930403279016e-15 5.512413150728771e-16
UnivariateLonger-f8 5.084908188957016e-17 1.853005688787183e-15
UnivariateLonger-f2 7.771561172376096e-16 2.8678670316439303e-16 exceptions: Map(f4 -> div-by-zero)
time: 458 ms
UnivariateEvenLonger-f0 1.46585219025164e-12 2.233871224149125e-15
UnivariateEvenLonger-f5 7.305267502033531e-15 2.523378331683749e-15
UnivariateEvenLonger-f7 1.847398102550191e-16 1.2641623150648763e-15
UnivariateEvenLonger-f3 1.868115632321407e-16 5.36320321311787e-16
UnivariateEvenLonger-f1 1.2983192636536467e-15 1.0036749209518803e-15
UnivariateEvenLonger-f6 1.665334536937735e-15 4.9511741508037193e-14
UnivariateEvenLonger-f9 1.0043285730083942e-15 -
UnivariateEvenLonger-f8 2.6063020734561265e-14 1.4942010295726542e-13
UnivariateEvenLonger-f4 8.309943296646378e-15 -
UnivariateEvenLonger-f2 9.903797721039754e-15 - exceptions: Map()
time: 1053 ms
I am a placeholder for this directory...
\ No newline at end of file
#!/bin/bash --posix
#
# This script
# 'Standard' benchmark set
declare -a files=("testcases/rosa/Bsplines.scala" \
"testcases/rosa/Doppler.scala" \
"testcases/real2float/Himmilbeau.scala" \
"testcases/control/InvertedPendulum.scala" \
"testcases/real2float/Kepler.scala" \
"testcases/rosa/RigidBody.scala" \
"testcases/trigApprox/Sine.scala" \
"testcases/trigApprox/Sqrt.scala" \
"testcases/control/Traincar4.scala" \
"testcases/rosa/Turbine.scala")
# Make sure the code is compiled
sbt compile
# generate daisy script
if [ ! -e daisy ]
then
sbt script
fi
# Run daisy on each testfile
for file in "${files[@]}"
do
./daisy --analysis=dataflow ${file}
done
\ No newline at end of file