2014 Benchmarks

In order to allow participants to easily compare the performance of their agents with participants of the 2013 and 2014 competitions, we benchmarked all agents that participated in the 2013 and 2014 Angry Birds AI competition. We ran them on the first 21 levels of the freely available Poached Eggs levels. These are the default levels when using the Chrome version of Angry Birds. Each agent had a time limit of 3 minutes per level on average, that is, a total time of 63 minutes for the 21 levels. Agents could spend the total time in any way they wanted. We used the same settings of the agents as in the competition. The following table gives an overview of the performance of all thirty agents (2014 agents in bold):

Rank Team Total Score Level 1-1 Level 1-2 Level 1-3 Level 1-4 Level 1-5 Level 1-6 Level 1-7 Level 1-8 Level 1-9 Level 1-10 Level 1-11 Level 1-12 Level 1-13 Level 1-14 Level 1-15 Level 1-16 Level 1-17 Level 1-18 Level 1-19 Level 1-20 Level 1-21
1 PlanA+ 1002380 30480 62370 40620 29000 69440 36970 32020 47320 26440 56830 47240 58210 34010 65640 54910 57530 51190 52120 39440 45980 64620
2 DataLab Birds 981120 31620 52000 41890 19790 70320 15700 45720 43190 50420 56790 50650 53420 32010 55640 46450 57380 48570 45730 35470 54680 73680
3 AngryHex (2013) 974670 30390 54160 41890 28000 64440 24990 36900 24860 49570 50570 53510 57750 42010 58190 46550 63430 46820 50020 38460 46970 65190
4 WISC 963160 29030 52180 41950 27850 65810 24640 25520 55810 33680 39170 50000 54980 32450 65060 49200 63430 54750 44740 37370 47980 67560
5 AngryHex (2014) 960320 32660 52580 41910 19690 68090 25180 24680 43330 42740 54890 53570 54860 41200 57150 41100 61470 50260 48050 36780 39010 71120
6 Angry Concepts 954030 29410 52250 41320 28160 64160 15660 24630 47170 48670 48290 56130 58600 50360 58050 43340 55000 45990 44030 37880 43730 61200
7 Beau Rivage 952390 29760 43160 40500 28680 61000 33540 45780 49150 33110 42200 57420 55600 35190 62770 47270 55890 49880 38820 29780 37020 75870
8 HungryBirds 951440 31210 53860 42040 20980 65700 28430 40580 27020 50710 53070 56260 55410 30130 59780 41040 55310 43530 46770 32690 56050 60870
9 AngryBER 935330 28510 43420 41910 19390 62880 35610 31980 45050 48670 51980 51550 54720 42510 45640 47090 50000 47740 44110 36450 35990 70130
10 RMIT RedBacks 933120 32220 53860 30480 19380 70350 33470 45740 29180 33320 59190 45250 56910 42300 45640 41540 66570 39370 48530 30460 40760 68600
11 Luabab 894840 29600 52180 40760 28030 66100 16860 32180 48330 41840 54110 45580 53040 41110 65640 28910 65670 39550 37680 16820 36970 53880
12 Dan 893370 29210 42760 41610 27990 63840 25700 45990 23390 45930 49570 38570 54990 32270 57550 47280 63000 42770 48290 22040 36910 53710
13 IHSEV (2014) 891590 29520 53070 41440 21860 56470 33470 29920 36630 40620 32300 31570 61070 41330 59250 34830 54160 47830 42840 40100 40470 62840
14 Impact Vactor 886990 29710 60480 42040 19700 65440 33870 36880 25720 34770 46870 57490 55230 49620 0 45860 58870 47070 48210 25040 37650 66470
15 Black Forest Cuckoos 874650 29880 52390 41600 28980 65380 0 32380 56310 23050 52360 54360 57750 29770 57560 55300 59940 52920 41410 36940 46370 0
16 IHSEV (2013) 861830 29360 52780 41240 36810 51860 33790 30130 57570 24310 29860 59070 40960 42840 65640 30700 51730 47940 47320 30940 0 56980
17 Naïve Agent (2013) 858730 29510 52230 40620 20680 55160 16070 21590 25730 35490 32600 46760 54070 49470 50590 46430 55210 48140 49430 37920 36790 54240
18 Sniper 785520 29760 42720 40500 18620 65850 35490 28780 48170 26960 35540 51150 49190 26180 65640 0 56530 37980 40460 30390 55610 0
19 Wanderer 774190 30840 60400 41900 36770 63550 26910 22070 57780 51480 68740 30620 42320 20050 58200 25520 38960 37560 35220 25300 0 0
20 Naïve Agent (2014) 756680 29760 43250 40180 10590 62490 14980 22150 35840 36050 52570 39310 48660 30000 45640 44190 52300 39530 39590 29460 40140 0
21 s-birds 754190 30080 26240 42240 19050 38160 36180 49120 38340 41670 54940 57950 47460 22550 63560 42990 65750 38790 39120 0 0 0
22 S-birds Avengers 706110 28520 51770 35380 27950 60920 26000 0 48010 49050 0 48320 45150 22130 53760 41240 0 45000 45750 38200 38960 0
23 Lambdaers 705010 30970 52390 42070 19580 63750 26400 45880 57600 49370 61820 44120 38390 29350 54340 44040 0 44940 0 0 0 0
24 A.Wang 680640 22400 43320 31910 28080 48440 24770 23960 27580 42590 57610 47410 46980 27490 65640 36160 66550 39750 0 0 0 0
25 Akbaba 641080 28640 35540 41910 19120 47470 0 23880 45380 36960 56000 48460 52310 0 59420 0 47230 44260 54500 0 0 0
26 AngryDragons 620390 28120 33440 30430 28820 65650 0 0 29340 25590 0 39580 51340 30840 55640 33920 53800 45660 38390 29830 0 0
27 ObjectS 569000 29670 43200 40620 11720 65850 15570 21310 37170 22610 51250 57930 45200 26570 65640 34690 0 0 0 0 0 0
28 AngryPKU 476100 18420 33280 24070 10120 35650 26450 0 27840 24660 30160 31740 45870 0 45640 32790 55890 0 0 33520 0 0
29 JulyPlayer 352340 29360 52520 35360 20690 46300 17400 21810 45370 48670 34860 0 0 0 0 0 0 0 0 0 0 0
30 FEI2 211870 28360 34160 30470 27650 64710 26520 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
  High Scores 1146160 32660 62370 42240 36810 70350 36970 49120 57780 51480 68740 59070 61070 50360 65640 55300 66570 54750 54500 38460 56050 75870
  2013 Highscores 1134920 31210 60400 42240 36810 65850 36180 49120 57780 51480 68740 59070 58600 50360 65640 55300 66550 54750 54500 38460 56050 75870
  3 stars 1042000 32000 60000 41000 28000 64000 35000 45000 50000 50000 55000 54000 45000 47000 70000 41000 64000 53000 48000 35000 50000 75000

It is interesting to see that 17 agents hold at least one high score for the 21 levels. But it is clear that solving more levels is better than having high scores. The score required in order to get a three star rating is listed as well and is taken from the angrybirdsnest website. In only 1 of the 21 levels, none of the agents received three stars, in level 14. 

Surprisingly, the clear winner of the 2014 competition is not the best agent in the benchmarks and does not hold an individual high score, but is overall better than any agent of the 2013 competition. The best agent in the benchmarks and the only agent who ever received a total score of more than 1,000,000 is PlanA+ who was eliminated in the semi finals by the tiniest possible margin. AngryBER who beat PlanA+ in the semi finals also does not have an individual high score. 

One major difference between the 2013 and the 2014 agents is that in 2014 the provided vision system detects the real shape of objects and also detects ground and hills. Without detecting those, some of the Poached Eggs levels above level 21 cannot be solved. Because this is now possible, we also benchmarked the 2014 agents on the second set of 21 Poached Eggs levels. We give the result in the following table: 

Rank Team Total Score Level 2-1 Level 2-2 Level 2-3 Level 2-4 Level 2-5 Level 2-6 Level 2-7 Level 2-8 Level 2-9 Level 2-10 Level 2-11 Level 2-12 Level 2-13 Level 2-14 Level 2-15 Level 2-16 Level 2-17 Level 2-18 Level 2-19 Level 2-20 Level 2-21
1 DataLab Birds 876090 64050 53130 108510 52620 78810 46040 45690 45090 23390 40620 0 31570 0 0 31120 56140 29440 55800 45580 0 68490
2 PlanA+ 703650 0 96180 99490 0 73460 51280 53450 49200 20640 43600 53470 46720 70930 45230 0 0 0 0 0 0 0
3 AngryBER 682530 48710 0 100570 53240 74940 57350 44700 0 21910 40720 90540 0 77000 44620 28230 0 0 0 0 0 0
4 AngryHex (2014) 541690 47530 0 98940 48580 76530 0 0 47170 25060 36600 87580 0 73700 0 0 0 0 0 0 0 0
5 Naïve Agent (2014) 503580 59480 0 91300 0 0 58270 51040 50300 46240 42330 0 32650 71970 0 0 0 0 0 0 0 0
6 AngryDragons 465740 59990 0 0 0 69900 35820 49210 57300 30470 23800 0 41140 65530 32580 0 0 0 0 0 0 0
7 IHSEV (2014) 440110 63350 45790 96480 0 0 56750 40880 50490 18680 26490 0 0 0 41200 0 0 0 0 0 0 0
8 RMIT RedBacks 405000 0 0 0 0 64980 0 49460 47510 23680 34470 0 0 67620 37970 0 0 0 41540 37770 0 0
9 Impact Vactor 327340 46110 0 0 49190 0 37240 48020 0 0 0 0 35880 67230 43670 0 0 0 0 0 0 0
10 S-birds Avengers 181310 0 0 96270 56550 0 0 0 0 0 0 0 0 0 28490 0 0 0 0 0 0 0
  High Scores 1209020 64050 96180 108510 56550 78810 58270 53450 57300 46240 43600 90540 46720 77000 45230 31120 56140 29440 55800 45580 0 68490
  3-stars score 1216000 60000 60000 102000 50000 80000 62000 50000 53000 28000 40000 69000 60000 70000 50000 50000 62000 36000 60000 47000 52000 75000

The top three agents of the competition are clearly the best agents on these levels, which are much more difficult than the first 21 levels. 6 of the agents have individual high scores and for 10 levels at least one of the agents has a three star score. From level 2-14 on, none of the agents has a three star score. Level 2-20 hasn't been solved by any agent and seems to be the most difficult level so far for AI agents. 

When considering all 42 levels, the three best agents of the 2014 competition are also the three top performers in the benchmarks, with team DataLab Birds well ahead: 

1. DataLab Birds 1857210
2. PlanA+ 1706030
3. AngryBER 1617860
4. AngryHex (2014) 1502010
5. RMIT RedBacks 1338120
6. IHSEV (2014) 1331700
7. Naïve Agent (2014) 1260260
8. Impact Vactor 1214330
9. AngryDragons 1086130
10. S-birds Avengers 887420

 

Male erectile dysfunction is a very popular problem for men aged 40 and more. Tadalafil Online treatment can help any man to fight this problem, but you must be sure about the contraindications. Generic Tadalafil treatment is very strong and effective. Check all the information on this web-site: