Android - GUI control via PC

For user who dont speak german please use this part of my forum
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

HTC

Beitrag von smart2smart »

Have tested on HTC Incredible S, working properly the first time itself. It seems there is an issue with getting it to work with Samsung devices, probably the port getting closed.

The previous post has the files you requested for where it didn't work.

CHeers,
Vikram.
AlienDroid
Beiträge: 24
Registriert: Mo 18. Jul 2011, 18:32
Wohnort: London UK

Beitrag von AlienDroid »

FJ hat geschrieben:Its already implemented in the current beta

I have tested it sucessfully on my X10 and Galaxy S2 (both non-rooted). Two known glitches:
- some apps does not react as expected to the Click (= touch) events. f.e. the dialer-app of the S2 and the Album-chooser in the galery-app
- its not possible to type special characters, this is caused throught a bug in the monkey-process in the phone and cannot be fixed

Please test and let me know if it works on your device

Thanx FJ
I've tried it but having some strange results.
Just now updated to the very latest Ver.
I'll list a few things below and some additional things I've noticed FYI.

"Phone Keypad"
Displays upside down.
Once screen locks display in MPE will not update using "Refresh Automatically" ticked.
It seems to go back to the Locked screen, but time not updating even tho Refresh is ticked!
I have some control when phone is open and I keep xxx.
I can scroll left and right.
But if I for e.g. Click the Music Player play button I get the "Add to Home screen" open on the phone, which is a bit wrong :(

"Menu" button seems to work, but that's in the middle on my Blade and not on the side, as it is in displayed in MPE.
"Home" button seems to work ok. Should be on the left not the middle but these do not really matter as they work.
xxx or double an app does nothing.
Holding left click for about a second brings up the popup to Remove or Edit etc etc. But does not launch the app.

Other MPE issues;
I have Connection set to Auto Detect. but when I have USB plugged in MPE remains connected using Wi-Fi.
This is stopping the phone from charging and it's getting hot with Wi-Fi on all the time. Temp showing 38c
Manually stopped Wi-Fi connection on fone. Now get error in MPE on PC "Connection to phone not possible"
Restart of MPE on PC will start USB connection once again.

SMS; (This only happened once so far!)
Message I was sending in MPE did not go into message list but did get
sent! I got a reply for it etc!
How can I get the message into the sent list as it is still open as if I have
not sent it?
Can save to draft, but can't move to sent folder!
Can't edit Draft sms to send. Have to Forward then reassign recipient.

Memory Status;
Phone memory and memory stick stats do not work.

Monitor;
CPU stats not working.

Screen is not always turned 100% off either USB or Wi-Fi. This doesn't happen on every connection!

Requested feature;
Add Alphabeticle list to phone book to shortcut to contacts. Needed for
large Contact lists! I know typing can filter tho!

SMS receipts to be saved as messages in inbox or other!

Would very much like the upside down view and control sorted, but the other things I've listed are not urgent and the core part of the program is working well.

Thanx in advance if you can fix any of the above.

PS. Does
C L I C K I N G
mean something rude in German lol as they've been xxx'd out!
Blade Android 2.3.4
CyanogenMod 7.1.0-RC1-Blade
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

hi

Beitrag von smart2smart »

Any luck identifying the issue with the log file ?
AlienDroid
Beiträge: 24
Registriert: Mo 18. Jul 2011, 18:32
Wohnort: London UK

Re: hi

Beitrag von AlienDroid »

smart2smart hat geschrieben:Any luck identifying the issue with the log file ?
Was that question for me?
FJ fixed my No.1 priority problem with the beta update which was the Calendar not syncing on my Blade, so I haven't looked at my log after that as I'm a happy bunny now I have most of what I want working.
I would like Notes and Tasks tho + email backup as I've had these features from about 8 years ago on an SE P800 and then P910 etc but maybe I can use something else. In saying that, this app does so much it would be great to have as much as possible working within this program as I hate the idea of having to have lots and lots of little apps to do separate tasks when it's clear to see many tasks can and should be controlled from within a single app :shock:
Blade Android 2.3.4
CyanogenMod 7.1.0-RC1-Blade
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

Nope

Beitrag von smart2smart »

Nope, it was for FJ.

The log file was for the screen control capability. It was working on some devices and not on others, the log is for a device where it was not working.

Cheers,
Vikram.
FJ
Site Admin
Beiträge: 32106
Registriert: Mi 15. Feb 2006, 01:16
Wohnort: Tirol
Kontaktdaten:

Beitrag von FJ »

@AlienDroid: MemoryStatus and CPU Usage will be fixed, SMS: i will check this, connection: after breaking WiFi you have to initiate again manually so click on Menu-Connect

@smart2smart: Sorry, the logfile did not help. Normally monkey does log any action, but there was nothing from monkey in the logfile. Maybe they did disable logging or monkey is missing on the tab. no matter, it does work on many devices so it will be released in this state. We will see how it works in wide range
Ich bitte um Verständnis daß ich aufgrund des hohen Aufkommens im Forum und meines zeitlichen Rahmens nichtmehr jeden Thread im Forum persönlich lesen bzw. beantworten kann.

Bitte benutzt auch die Forum-Suche bzw. die FAQ
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

Beitrag von smart2smart »

Ok, Thanks for the update, any planned release date ?

Cheers,
Vikram.
AlienDroid
Beiträge: 24
Registriert: Mo 18. Jul 2011, 18:32
Wohnort: London UK

Beitrag von AlienDroid »

FJ hat geschrieben:@AlienDroid: MemoryStatus and CPU Usage will be fixed, SMS: i will check this, connection: after breaking WiFi you have to initiate again manually so click on Menu-Connect

Thanx for the update FJ.

Sorry about the long notes I'm listing below. Just to give an idea of the problems I'm having. I'm struggling to get a USB connection. I've had to set connection to USB Cable only for the time being under settings.

My USB problems;
MPE notes;
PC MPE has to be running first or a wi-fi connection or will not start.

Phone keyboard wont launch.
After starting MPE on PC, then phone keyboard wont launch.
Error says. No device attached to USB.

Note status shows a good Wi-Fi connection.
Click-ing F1 disconnect & reconnect doesn't fix this problem.
Not an issue for me just yet as phone display is upside down. But just
informing FYI!
I can see the client on the phone is running, but I've lost the connection.
Error when trying to access Calendar etc. Connection to phone could not
be established: No device attached to USB

Note this session I haven't tried to use USB at all. So I assume it's trying
USB as it can no longer access Wi-Fi for some reason!
Restarting MPE on PC did not resolve this.
Restarting client on phone got the Wi-Fi connection back!
Wi-Fi dropped again while I'm actively using MPE.
In Messages, clicked Download arrow and got the same USB connection
error message.

Ok I think I can see why I'm losing Wi-Fi.
When my Blade's screen sleeps, i.e. after the 2 minutes time-out I've set it for at the moment, that's when I lose Wi-Fi connection!
F1 will not reconnect.
Wi-Fi for about a minute on MPE status will still show connected and will
not give an error when trying to download messages etc. After about a
minute it will then give the above USB error message.
Blade will ONLY reconnect if I unlock the phone screen!

When I have Wi-Fi connected and plug in USB cable, if I F1 to Disconnect
and again F1 to Reconnect it Reconnects to Wi-Fi and not USB!
The strange this is now when my Blade's screen is in sleep mode and
locked Wi-Fi still remains connected!!
Note. Downloading Contacts Reconnects Wi-Fi without hitting F1
Restarting MPE on PC with USB cable still attached connects to Wi-Fi and
not USB.

Exiting client on Phone and restart. Then F1 in MPE with USB cable still
attached reconnects to Wi-Fi

I'm still able to use MPE ok but have to change the connection type manually for the time being!
Cheers.
Blade Android 2.3.4
CyanogenMod 7.1.0-RC1-Blade
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

Working model

Beitrag von smart2smart »

Implemented a method using the MonkeyRunner itself. It works on all the devices I have tested with however the functionality is limited.

I still feel the only issue with what you have released is in the initialization with the adb.

Have a look ...

http://piglings.blogspot.com/2011/08/an ... -root.html
FJ
Site Admin
Beiträge: 32106
Registriert: Mi 15. Feb 2006, 01:16
Wohnort: Tirol
Kontaktdaten:

Beitrag von FJ »

@smart2smart: is this your blog ? Does it have no initialisation issues ?

@AlienDroid: Loading screenshots and controlling the phone in this new way does work in general only throught USB cable
Ich bitte um Verständnis daß ich aufgrund des hohen Aufkommens im Forum und meines zeitlichen Rahmens nichtmehr jeden Thread im Forum persönlich lesen bzw. beantworten kann.

Bitte benutzt auch die Forum-Suche bzw. die FAQ
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

No problem

Beitrag von smart2smart »

@FJ

Yes it is my blog. No there is never any initialization issues. Using the Monkeydevice.waitForconnection() it always picks up the device.

The only problem so far is that on the Samsung Galaxy Ace device the screen comes blank on the computer but the inputs still work. This is an issue of the pixel depth in my mind.

It would be ideal if the method here was incorporated into your build as it always picks up the connected device without any issue.

Cheers,
Vikram.

P.S. This worked on the Galaxy Tab where I had a problem with your build and posted the log files as well.
FJ
Site Admin
Beiträge: 32106
Registriert: Mi 15. Feb 2006, 01:16
Wohnort: Tirol
Kontaktdaten:

Beitrag von FJ »

MyPhoneExplorer does already exactly the same as MonkeyDevice but via native TCP-Calls. Its not possible for me to implement Java-Library into the PC-Program but i was able to translate the source of MonkeyRunner

By the way: The problems which i saw in your blog can be fixed with pressing instead of typing:
press space
press enter
press del
Ich bitte um Verständnis daß ich aufgrund des hohen Aufkommens im Forum und meines zeitlichen Rahmens nichtmehr jeden Thread im Forum persönlich lesen bzw. beantworten kann.

Bitte benutzt auch die Forum-Suche bzw. die FAQ
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

ok

Beitrag von smart2smart »

Understood, Not sure why the TCP calls are getting blocked. Will let you know if I get some information about that.

Thanks for the info on the MonkeyRunner tool. Can you please update here if there is any change in your implementation with regard to the TCP calls so that I can test.

Cheers,
Vikram.
FJ
Site Admin
Beiträge: 32106
Registriert: Mi 15. Feb 2006, 01:16
Wohnort: Tirol
Kontaktdaten:

Beitrag von FJ »

I updated the beta, please test again and post the logfile if it fails
Ich bitte um Verständnis daß ich aufgrund des hohen Aufkommens im Forum und meines zeitlichen Rahmens nichtmehr jeden Thread im Forum persönlich lesen bzw. beantworten kann.

Bitte benutzt auch die Forum-Suche bzw. die FAQ
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

Sorry for the delay

Beitrag von smart2smart »

Was traveling, I will test this out on the devices I had a problem with and will update back in a day.

Would like to know what changes have you made.

Thanks,
Regards,
Vikram.
FJ
Site Admin
Beiträge: 32106
Registriert: Mi 15. Feb 2006, 01:16
Wohnort: Tirol
Kontaktdaten:

Beitrag von FJ »

Before:
MyPhoneExplorer tried to connect directly after starting monkey-process

Now:
MyPhoneExplorer tries every 200ms to connect and gives up after 4 seconds (~20 tries)
Ich bitte um Verständnis daß ich aufgrund des hohen Aufkommens im Forum und meines zeitlichen Rahmens nichtmehr jeden Thread im Forum persönlich lesen bzw. beantworten kann.

Bitte benutzt auch die Forum-Suche bzw. die FAQ
smart2smart
Beiträge: 14
Registriert: Mo 25. Jul 2011, 06:22

Works much better

Beitrag von smart2smart »

Hi,

Want to let you know that it is working great. It didn't connect on one ZTE blade on the first attempt but worked on the second one.

I also got it tested across 4 different PCs with 6 different Samsung Galaxy Ace devices and they all managed to connect.

Devices Tested on
LG Optimus One
Samsung Galaxy S
Samsung Galaxy Ace (7 devices)
HTC Incredible
ZTE Blade
Samung Galaxy Tab ( Landscape mode only)

Have understood the change and it makes sense, it is quite stable and is working great.

Thanks for the updated logic, I know that there are tons of requests out there and I really appreciate that you took the trouble to incorporate the change.

Cheers
Vikram.
cthoma00
Beiträge: 6
Registriert: Do 2. Feb 2012, 21:29

ROOTED DROID RAZR

Beitrag von cthoma00 »

i have a rooted droid razr and the phone screen shot (phone keypad) it connects the first time and then after a little bit it will not reload the screen, does not want to connect after the first connection but MPE will connect but not keypad some help please.
FJ
Site Admin
Beiträge: 32106
Registriert: Mi 15. Feb 2006, 01:16
Wohnort: Tirol
Kontaktdaten:

Beitrag von FJ »

No doubleposts please
Ich bitte um Verständnis daß ich aufgrund des hohen Aufkommens im Forum und meines zeitlichen Rahmens nichtmehr jeden Thread im Forum persönlich lesen bzw. beantworten kann.

Bitte benutzt auch die Forum-Suche bzw. die FAQ
empirio
Beiträge: 1
Registriert: Sa 16. Jun 2012, 12:09
Wohnort: München

Beitrag von empirio »

What a cool App.

First with my Dell Streak 5 (Andoroid 2.2.2) I had the problem, that the remote screen did not work. It was upside down and I had the impression xxx the apps did not work either.

Installing the 1.8.3 beta version solved the problem.
It works fine now.

I found one little bug: typing in characters ä,ö,ü is not possible.
Antworten