Android Benchmark Results for 2011-07 Engineering Cycle

About

The results in this page were conducted to compare various Linaro and Android toolchains using the Android Benchmarking Tools

logo

The toolchains used were:

The target device tested was a PandaBoard running

summary of % improvements from Andrdoid 4.4

Summary of Results

  • skia individual tests vary. However, the total time shows a consistent improvement for each version.

  • cximage Last month all Linaro toolchains were slightly slower. This month the 4.6 toolchain were slightly faster.

  • gcstone varied, but seems to be improving with newer releases

  • gnugo 4.5 and 4.6 are doing better.

  • python inconsistent, but 4.5 and 4.6 performed best by total time.

The 4.6 graphite optimization "-floop-interchange -floop-strip-mine -floop-block" were inconsistent.

The chart on the right shows percent improvements against Android 4.4. This was done by comparing the cumulative totals for each benchmark.

Ranking in order by percentage improvements:

Linaro 4.6

3.71%

Linaro 4.6-06

3.69%

Linaro 4.5

3.62%

Linaro 4.6 graphite

3.52%

Methodology

The raw data this page is based on can be found at:

The scripts used to generate the data can be found at

skia results

NOTE: smaller numbers are better

histogram

TEST

skia-android-4.4

skia-linaro-4.4

skia-linaro-4.5

skia-linaro-4.6

skia-linaro-4.6-06

skia-linaro-4.6-graphite

decode_4444_(null)

0.00

0.00

0.00

0.00

0.33

0.00

decode_565_(null)

0.00

0.00

0.07

0.00

0.00

0.00

decode_8888_(null)

0.00

0.27

0.00

0.00

0.27

0.00

repeatTile_index8

154.67

158.87

155.07

154.67

154.87

156.13

repeatTile_4444

202.27

202.53

198.87

182.27

181.53

182.80

repeatTile_565

140.27

129.40

124.80

124.27

124.27

122.60

repeatTile_8888

154.53

155.40

154.80

153.33

153.47

153.07

bitmap_index8

69.87

68.67

67.93

68.73

67.40

68.60

bitmap_index8_A

145.20

145.40

140.53

142.07

142.67

143.07

bitmap_4444

52.60

51.93

59.40

51.73

52.93

52.93

bitmap_4444_A

132.07

120.33

130.47

126.00

126.07

126.13

bitmap_565

142.93

135.60

132.53

130.87

131.73

131.67

bitmap_8888

24.93

24.47

24.60

25.00

24.27

24.80

bitmap_8888_A

83.67

85.13

80.27

82.73

82.13

81.40

polygon

129.27

125.00

123.80

123.93

123.87

122.40

lines

36.93

35.93

33.87

35.13

35.33

34.67

points

3.80

7.93

7.87

8.60

8.13

8.40

rrects3

13.60

14.00

13.47

14.73

13.87

13.40

rrects1

43.53

43.27

42.87

45.73

46.07

46.13

ovals3

15.33

15.27

14.73

16.07

16.07

15.87

ovals1

50.40

51.00

49.47

54.27

54.13

53.07

rects3

1.27

1.47

1.00

1.07

0.27

1.20

rects1

8.87

9.47

9.33

8.13

9.00

9.33

python results

NOTE: smaller numbers are better

Histogram View of Results

TEST

python-android-4.4

python-linaro-4.4

python-linaro-4.5

python-linaro-4.6

python-linaro-4.6-06

python-linaro-4.6-graphite

BuiltinFunctionCalls

479

304

512

494

507

543

BuiltinMethodLookup

375

161

370

379

338

364

CompareFloats

395

395

368

368

397

366

CompareFloatsIntegers

369

445

308

398

366

395

CompareIntegers

404

443

329

385

323

397

CompareInternedStrings

489

448

403

433

503

427

CompareLongs

395

369

354

396

388

422

CompareStrings

368

384

305

361

361

364

CompareUnicode

438

384

338

341

364

346

ComplexPythonFunctionCalls

443

288

493

515

509

540

ConcatStrings

655

474

640

639

626

633

ConcatUnicode

540

589

525

495

532

498

CreateInstances

547

567

543

532

580

563

CreateNewInstances

547

449

423

463

305

396

CreateStringsWithConcat

363

408

385

458

595

503

CreateUnicodeWithConcat

341

322

346

327

339

311

DictCreation

219

297

260

267

258

257

DictWithFloatKeys

213

386

343

367

341

352

DictWithIntegerKeys

603

357

349

369

326

371

DictWithStringKeys

383

343

339

364

442

295

ForLoops

328

328

335

312

325

321

IfThenElse

325

279

275

304

306

289

ListSlicing

374

403

445

410

417

434

NestedForLoops

362

450

365

379

398

378

NestedListComprehensions

551

470

526

565

572

564

NormalClassAttribute

400

253

443

396

298

399

NormalInstanceAttribute

407

410

348

345

476

330

PythonFunctionCalls

430

332

411

389

396

374

PythonMethodCalls

591

423

509

536

410

554

Recursion

593

839

524

532

541

533

SecondImport

593

616

606

599

580

617

SecondPackageImport

646

643

623

622

611

635

SecondSubmoduleImport

780

537

752

771

760

786

SimpleComplexArithmetic

325

607

326

317

340

341

SimpleDictManipulation

450

291

374

403

386

391

SimpleFloatArithmetic

447

570

388

355

366

381

SimpleIntFloatArithmetic

336

241

199

272

306

312

SimpleIntegerArithmetic

331

412

292

296

299

305

SimpleListComprehensions

482

499

470

504

473

386

SimpleListManipulation

358

353

305

329

335

430

SimpleLongArithmetic

410

316

360

381

249

390

SmallLists

456

450

436

443

439

447

SmallTuples

449

454

420

449

426

365

SpecialClassAttribute

404

408

407

392

432

393

SpecialInstanceAttribute

521

485

489

446

473

432

StringMappings

485

304

393

380

370

391

StringPredicates

431

446

403

394

393

400

StringSlicing

483

418

483

489

449

476

TryExcept

418

484

382

390

362

392

TryFinally

482

484

453

441

454

420

TryRaiseExcept

465

419

449

431

430

452

TupleSlicing

408

241

382

408

386

407

UnicodeMappings

492

307

511

504

479

517

UnicodePredicates

460

481

383

432

459

419

UnicodeSlicing

472

295

434

434

427

427

WithFinally

640

691

591

569

589

558

WithRaiseExcept

556

690

561

571

565

527

Totals

25707

24142

23983

24544

24378

24517

gnugo

NOTE: smaller numbers are better

Toolchain

Time (in seconds)

gnugo-android-4.4

105.71

gnugo-linaro-4.4

104.84

gnugo-linaro-4.5

97.76

gnugo-linaro-4.6

98.51

gnugo-linaro-4.6-06

97.62

gnugo-linaro-4.6-graphite

98.02

gcstone results

histogram

NOTE: smaller numbers are better

TEST

gcstone-android-4.4

gcstone-linaro-4.4

gcstone-linaro-4.5

gcstone-linaro-4.6

gcstone-linaro-4.6-06

gcstone-linaro-4.6-graphite

Total Array Alloc Time

122

116

99

95

110

102

Total Array GC Time

18

16

27

18

16

18

Total List Alloc Time

3149

3310

3212

3418

3763

3244

Total List GC Time

620

627

617

620

617

625

cximage

NOTE: smaller numbers are better

Toolchain

Time (in seconds)

cximage-android-4.4

31.43

cximage-linaro-4.4

31.67

cximage-linaro-4.5

31.71

cximage-linaro-4.6

31.39

cximage-linaro-4.6-06

31.48

cximage-linaro-4.6-graphite

31.40

Platform/Android/AndroidToolchainBenchmarking/2011-07 (last modified 2011-07-27 23:32:40)