Add all the general test functions for Optimisation

[bhavnicksm]

There are many test functions for Optimisation that are used. This issue is to keep track of which have been implemented in this repository and which are still remaining

Test functions to Implement

• Thevenot (Thevenot)
• Ackley (AckleyN1)
• AckleyN2 (AckleyN2)
• AckleyN3 (AckleyN3)
• AckleyN4 (AckleyN4)
• Adjiman (Adjiman)
• Alpine N.1 (AlpineN1)
• Alpine N.2 (AlpineN2)
• Bartels (Bartels)
• Beale (Beale)
• Bird (Bird)
• Bohachevsky N. 1 (BohachevskyN1)
• Bohachevsky N. 2 (BohachevskyN2)
• Bohachevsky N. 3 (BohachevskyN3)
• Booth (Booth)
• Branin (Branin)
• Brent (Brent)
• Brown (Brown)
• Bukin N. 6 (BukinN6)
• Colville (Colville)
• Cross-in-Tray (CiT)
• De Jong N. 5 (DeJongN5)
• Deckkers-Aarts (DeckkersAarts)
• Dixon Price (DixonPrice)
• Drop-Wave (DropWave)
• Easom (Easom)
• Egg Crate (EggCrate)
• Egg Holder (EggHolder)
• Exponential (Exponential)
• Forrester (Forrester)
• Goldstein-Price (GoldsteinPrice)
• Gramacy & Lee (GramacyLee)
• Griewank (Griewank)
• Happy Cat (HappyCat)
• Himmelblau (Himmelblau)
• Holder-Table (HolderTable)
• Keane (Keane)
• Langermann (Langermann)
• Leon (Leon)
• Levy N. 13 (LevyN13)
• Matyas (Matyas)
• McCormick (McCormick)
• Michalewicz (Michalewicz)
• Periodic (Periodic)
• Perm d, beta (Perm)
• Perm 0, d, beta (PermZero)
• Powell (Powell)
• Qing (Qing)
• Quartic (Quartic)
• Rastrigin (Rastrigin)
• Ridge (Ridge)
• Rosenbrock (Rosenbrock)
• Rotated Hyper-Ellipsoid (RotatedHyperEllipsoid)
• Salomon (Salomon)
• Schaffel N. 1 (SchaffelN1)
• Schaffel N. 2 (SchaffelN2)
• Schaffel N. 3 (SchaffelN3)
• Schaffel N. 4 (SchaffelN4)
• Schwefel (Schwefel)
• Schwefel 2.20 (Schwefel220)
• Schwefel 2.21 (Schwefel221)
• Schwefel 2.22 (Schwefel222)
• Schwefel 2.23 (Schwefel223)
• Shekel (Shekel)
• Shubert (Shubert)
• Shubert N. 3 (ShubertN3)
• Shubert N. 4 (ShubertN4)
• Sphere (Sphere)
• Styblinski Tank (StyblinskiTank)
• Sum Squares (SumSquares)
• Three-Hump (ThreeHump)
• Trid (Trid)
• Wolfe (Wolfe)
• Xin-She Yang (XinSheYangN1)
• Xin-She Yang N.2 (XinSheYangN2)
• Xin-She Yang N.3 (XinSheYangN3)
• Xin-She Yang N.4 (XinSheYangN4)
• Zakharov (Zakharov)

Reference

• Blog on test functions for Optimisation
• https://www.sfu.ca/~ssurjano/optimization.html
• https://github.com/3springs/viz_torch_optim
• http://louistiao.me/notes/visualizing-and-animating-optimization-algorithms-with-matplotlib/
• https://github.com/IoannisAntonoglou/optimBench