Crosswalk Performance Mega-thread

First, imaffett thank you for your help!

Like others we had to upgrade from 7/8 to 10 due to the OpenSSL alert in GooglePlay and noticed an evident drop in the framerate. In addition, CSS animations became very leggy (on Android chrome 40 framrate is significantly better and CSS animations run smoothly).

One of the thing we had to do is to disable GPU rastarization as otherwise we got incorrect pixel rendering issue on some devices. We opened an issue on that (XWALK-3614) but so far it remains unresolved. Is it possible that GPU rastarization is related to the performance degradation from CW10 (at least for the CSS animations)? Strangely, we didn't see anyone else that complains on this issue, though we've reproduce this issue (on the specified devices) for other applications.

We are really looking forward for a fix for the performance issue introduced in CW10. I believe this issue is critical not only for us...

imaffett

I've made a game just for testing, it's a modified C2 templete originally made by Tom. I hope for more people to join and get better measurements so if you want to help with testing, here's how (for all who have already downloaded crosswalk shell, you can skip to the game's link in the list item #3):

• Download crosswalk shells and install on your device
• After you run one of the shells, insert the link below into the text box
• Test game link - http://ow.ly/KQkro
• The game will run for 20 seconds, after that it will show the renderer used and minimal/maximal/average fps
• Post your results here. Done, thank you

Optional:

If the game runs in canvas 2d, you can try and download cw shells with webGL mode forced on and compare the results. In my experience it's not worth it, there's always been fps drop off when using it.

Source:

Test game capx.

Noga

Time is jumping between 20 and 19, it'll never end

Score is how I see lagging while playing it, lower is better.

Samsung Galaxy Tab 3 SM-T110 - Android 4.4.2

cw07 | canvas 2d | min 40 fps | max 46 fps | avg 42 fps | score 1 | good

cw10 | canvas 2d | min 30 fps | max 42 fps | avg 36 fps | score 2 | lags, jumps

cw11 | canvas 2d | min 29 fps | max 34 fps | avg 31 fps | score 3 | lags, jumps

cw12 | canvas 2d | min 24 fps | max 28 fps| avg 25 fps | score 4 | lags, jumps

blacklist OFF

cw10 | web GL | min 31 fps | max 40 fps | avg 35 fps | score 3 | lags, jumps

cw11 | web GL | min 32 fps | max 35 fps | avg 33 fps | score 2 | lags, jumps

cw12 | web GL | min 31 fps | max 37 fps | avg 34 fps | score 1 | lags, jumps

GIGABYTE GSmart Guru G1 - Android 4.2.1

cw07 | canvas 2d | min 38 fps | max 41 fps | avg 39 fps | score 3 | lags, jumps

cw10 | canvas 2d | min 44 fps | max 46 fps | avg 45 fps | score 2 | ok, little lags&jumps

cw11 | canvas 2d | min 44 fps | max 46 fps | avg 44 fps | score 1 | good, little lags&jumps

cw12 | canvas 2d | min 29 fps | max 32 fps | avg 30 fps | score 4 | lags, jumps

blacklist OFF

cw10 | web GL | min 34 fps | max 37 fps | avg 35 fps | score 0 | unplayable

cw11 | web GL | min 34 fps | max 38 fps | avg 35 fps | score 0 | unplayable

cw12 | web GL | min 36 fps | max 39 fps | avg 37 fps | score 0 | unplayable

Samsung i9300 Galaxy S III - Android 4.3

On this device for the first time the cw7 lost to newer cw versions, but only by couple fps. Interesting is, that when using cw7, the mode switched to canavas 2d. In cw10+ it was webGL.

Results are:

cw7 = avg fps 57

cw10+ = avg fps 59

all versions - smooth, very good

Samsung Galaxy Tab Pro 8.4 SM-T320 - Android 4.4

All versions in webGL mode and average fps 60. Again, only cw7 losing couple fps, but this time in webGL mode.

all versions - smooth, very good

Time is jumping between 20 and 19, it'll never end

Ok, I'll check it out

You have to actually play the game. Tap or click on the screen. I've made it super easy so shouldn't be a problem finish it. When you crash a pipe or ground the game restarts, that's why that timer jumping.

Noga

Ok, thanks

i thought it's a demo played automatically for 20 secs

I'll come back with test results

Noga

Test results on Galaxy s3 mini

Crosswalk 7 (canvas 2d)

Min = 52 | Max = 59 | avg= 56.9 (AMAZING!)

Crosswalk 10 (canvas 2d)

Min= 34 | Max = 40 | avg = 36 (poor - too much lag)

Crosswalk 11 (canvas 2d)

Min= 36 | Max= 42 | Avg= 38 (poor - lag)

Crosswalk 12 (canvas 2d)

Min= 19 | Max= 24 | Avg = 22 (****! and totally unplayable)

This is it.

Egyptoon

I see results of your tests and I want to cry. OMG...

Crosswalk = Slowwalk

I see results of your tests and I want to cry. OMG...

Crosswalk = Slowwalk

Can you try the test on your device? See this post

Can you try the test on your device? See this post

Alcatel One Touch Flash - 8 core MediaTek MT6592M - Android 4.4

CW7 - webgl - min. 56 - max. 59 - avg. 57.84

CW10 - webgl - min. 51 - max. 59 - avg. 56.25

CW11 - webgl - min. 54 - max. 59 - avg. 57.50

CW12 - webgl - min. 57 - max. 59 - avg. 58.17

CW7 = 1 jitter per pipe

CW10-12 = 2-3 jitters per pipe

CW12 has avg. FPS better than CW7 but CW7 in practice works better

anyway it only proves that CW7 can run game with 1 simple sprite and pipes with bullet behavior (I guess). It would be nice to see something with more objects, behaviors and so on.

szymek

Your test device came with useless results because it's very powerful, it can run anything and you will NEVER feel a difference in fps. as if you run the game on a PC, please try something else, s3 , s4 , etc

Egyptoon

but as you can see - even on powerful mobile I can't play very simple C2 game at 60 fps, 100% smooth, 0 jitters with Crosswalk.

szymek

That's exactly what makes me mad. this issue MUST be FIXED somehow ASAP or C2 will be totally useless.

after all those tests I'm waiting for results very soon from Intel and Crosswalk

or C2 MUST provide native exporter or even replace the whole software with a new one makes NATIVE android and ios.

szymek

BTW I'm just looking for 40 fps, it'll be enough for games to be playable , and i can't even get this without crosswalk 7, according to those results the future is DARK, No, totally BLACK with no hope, Xwalk 10,11,12 ---- > stop "downgrading" please they are all useless.