Problems with RecyclerView image loading when scrolling with dpad #131

I'm using androidquery to async load images from an http server. This works perfectly with the generic Android ListView. But now I switched to the new RecyclerView and now I'm getting some problems when scrolling with the dpad.

When I'm scrolling down with a dpad (e.g. on an Android Tv) and androidquery is loading an image via http the focus jumps to the top of the RecyclerView for some reason. This repeats every time a new image is loaded from the server, so I can only scroll the list very slowly. Also this doesn't happen when the images are loaded from the cache.

Any ideas what could cause this problem?