Content: index_20100212220744.htm
Parent: Brian Reynolds ibook Identity Folder | Copied To 		Contributor: br
Date: 2010 Fri Feb 12 22:07:44 CST
Previous Revision | Revision Index

Voice System Road Map


This is the folder Voice System Road Map

by Brian Reynolds of Family Systems® for Verbol Web Server V3 adding behaviour to web sites featuring Voicechat implemented by the Voice System.  This is a working document subject to change at any time. 

We are at V3.0 build 86 which includes all the voice components, is on display in our demo system at demo.verbol.com and is now available in open source for self supported use at Voice System.  This is the first opportunity to download and install our experimantal prototype voice system, and you may have questions and experience to share; we look forward to cooperating with you. 

With your support and care and with cooperative users, this build is suitable for you to try out in real life in a pilot or case study setting (closed/open).  We are in need of help to undertake all the improvements identified in this road map.  We are sure you will think of more....., please add to this page; rather than delete, mark as obsolete.  Thanks.

A.  For demo release build 86   STATUS ADDED 8 OCT 09

Complete remaining navigation buttons with voice control keys always visible, tooltips indicating touch tones, DONE
and other demo usability issues as detailed below. TODO

Make Brian's Identity page spawnable on enrolment DONE
and enable extension in enrolment form (see bugs below). STILL NEEDS MANUAL FIX UP

Publish sources and licenses. DONE

Publish verbol definitions.  TODO

Spawn demo release to several personal systems on laptops and migrate demo.verbol.com to a hosted Family Systems pilot system able to support conference calls.  Freeze demo system on demo.verbol.com? TODO

Arising

Google Wave gadget to Skype demo.  From a Wave gadget incorporating PFH, call a skype client and accumulate links in the gadget DONE
with ability to play in sequence as the Wave is replayed TODO.  Same gadget to add voicechat to the wave TODO. 

Merge Wave gadget with demo PFH with keypad and buttons.  Add transcription links to generated messages and possibly translate and check link.

Enable each side of call to turn recording off and on by * and send messages back to phones to indicate whether recording is off or on for each channel of a call and display these in pfh and gadget.

Update the dial plan so that each identity folder captures both incoming and outgoing calls or links to them in its daily journal whether to or from skype, exten, POTS etc.

Notifications to email of new conversations whether from a call or voicechat and optional regular email update of contents, eg after translation.

New bug. Bookmarks not working; the links appear correct but do not end up at the message when clicked after emailing that message. 

Integrate Waves as Topic Rooms in parallel to our identity folders; upload the voice recordings to Wave so the personal systems creating them can be on our netbooks or web service and we share through waves in parallel.

B.  Core devt stream on demo V3.0 build 87 and onwards:-

0. Finish off any spillover from demo release such as on/off buttons for each option with server confirmation message causing them to show green when on;

a. full topic support and extend usability with additional features such as delete and Voice-announcements.pdf.  Now considering using Waves for topics; this would be the first spin off from enabling messages through the phone, others are possible eg see emailed notes re Skype.

b. Improve caller and callee identification, eg if I am called in 801 show me as callee, and others we can fix up like calls from Skype.

c.  use the identification to enable speaker dependent improvement of voice recognition for transcription.

d. selected bugs such as autorefresh and email picklist.

1. enable group chat roster in the page, along with voice controller and PhoneFH,  my rough suggested layout at Browser-window-layout.pdf.  This permits:-

a. controlling voicechat to this extn from any phone, (this may benefit from a newer version of Asterisk).
and chitchat becomes an option of voicechat. Also own messages go to own identity.
(description Exten 4803 msg 3415 to 3443)
34162: 15:20:10 can voice controller apply to any phone? : Brian Reynolds[Fri Sep 11 10:57:57 2009]<iBot-In> 15:20:14  

b. cooperative browsing, see issued web collaboration patent claims. 

c. verbol scripting and a beginning script to enable a persona to converse and cause its identity to do helpful things; may use HTML 5 Web Worker.

d. Navigating topics and replies. ( Review whether chat makes unecessary the addition of annotation and topics from the voice controller?)

2.  Enable phone in Play List

The play page menu item needs an alternative to generate a telephone playlist and point the phone in use to it, so we can hear and reply in the threaded order.  This would permit us to insert browse commands so a presentation can be created.  And number folders and pages so we can dial into them to play and leave messages. Voice notes from 4801 message 2930 to 2960.

3.  Istamps and Topics Exten 4803 msg 3401 to 3414
3401334: 19:37:20 istamp self link : Brian Reynolds[Fri Sep 11 10:57:57 2009]


4.  enhance chitchat for music, described in voicechat.  See also useful-modes.pdf, SILK and Wideband+VoIP. 
The subject has been changed to:Sat Sep 19 16:45:46 2009<iBot-In>16:45:46 
286087: 16:45:56: Brian Reynolds[Sat Sep 19 16:45:46 2009]<iBot-In> 16:46:01  >>16:46:03
 

NB. All these improvements may be made available as successive builds of the V3.0 demo release.


C.  wider integration possibly in parallel

Follow up on utilising Google Talk, Aim, Skype chat etc?

Integrate transcription services from Google, Spinvox, etc

Search integration including on private pages.

Consider verbol input like Ubiquity and adding our verbol commands to Ubiquity? 

enable use of continuous recordings and ibots creating voicechat in parallel to Asterisk and other recording sources such as Skype with Ecamm.

Evolve use of Wave and when available consider incorporating a Wave server, possibly in due course replacing Jabber and Apache if Wave fulfills all its potential; see www.waveprotocol.org. 

upgrade Asterisk for V3.1 release,

this can be done by another contributor in parallel to the development improvements listed above, and adopt them when ready. 

It permits personal voice systems with more Digium and third party features such as
fax to/from email
Skype to Asterisk directly with Digium's Skype channel or alternative which may be sufficient for personal system
voice commands (not yet transcription) and text to speech.

We wish to create a packaged system capable of spawning itself and being utilised by anyone with cooperative support.

Also, with transcription, achieve better targeted advertising for conversations or part thereof, eg RG's vision of the Avenue in paris you are talking about coming into view, then its stores and their web delivery etc.

also possibly in parallel by contributors close to their markets, and with possible operational dependency on V3.1

Create and deploy a Facebook version.  Linked-in etc.

Create and deploy a Google Apps version.

Similar opportunities,  see Techcrunch50, Amazon etc.


demo release known issues


parameter delimeters
 
Chris just edited the voicechat phone page to pass the params to the iframe src using { } instead of back ticks.http://demo.verbol.com/pfh-ibook/index.htm

Brian looked in the source and found that {} is also being converted and needs setting back and saving while in source mode.  We still have the problem of having to edit the fixups which are more now - is there another choice of delimiter we can use?

problem of phone window being lost behind id or journal window

I tried using the phone in top window of a browse split and think it can help;

I changed the anchor target attributes to ibook for calls to 4801 and 801 in  Brian Reynolds identity :-

After experiencing the split screen by copying the browser url, clicking browse button, then pasting the url, I found:-

Browse without a url should copy the present url into the bottom window rather than have a verbol error.  Also, we need an exit from split window mode.

We need to put a book mark for our controller into the links - what is it?  Then change the message template to use ibook as target with  the bookmark.

Needs an exit mechanism

Good news; repeat clicks are now causing a reload; did you do something?

Bugs

The message number does not show when the phone is called at end; in fact the earlier position shows which is confusing.  SOME IMPROVEMENT, MORE TODO

Play page without duplicates plays first message repeatedly.  The highlighting also shows up the timestamps in the links rather than in the messages which looks confusing.

Complete updating message template (at present we get extra messages in threaded playlist as the identity link still points to a message rather than an identity).  IDENTITY LINK NOW TEXT, FURTHER EVOLUTION POSSIBLE

Fix scrolling to previous location on refresh after form or during and after editing. 
NB the Google Ads seem to position to their top after a refresh, can we stop that?

The extension field in the enrolment form does not pass into the contact info page.  Ensure this automates the VOIP set up.

Navigation issue; when playing after msg 2621 and clicking the |<< button in PFH, it wont back up past message 2621, though using 0220 seems to work.  May be caused by a short message.

Message is hidden by verbol menu when we follow a bookmarked link.

The identity pages such as BR have a link to a parent page Parent: Verbol Identities, but this is empty.  The Guest2 identity instead has Parent: Reception Area which has the link View identity which goes to the same empty page.  This page cannot be edited to add links to the identity pages and editing fails with verbol error.  Also the Topics page which is shown as the parent of the Wave folder does not list Wave and cannot be edited.

In JWChat, the windows are mostly too small so the buttons are not visible and there are no scroll bars; in preferences sounds should be turned off by default; we should generate the autojoin of a group chat room for this extension ie from the identity of the page from which chat is launched; the default sizing of the group chat window needs to have a wider contributor list so we can see the actions without messages wrapping and affecting the line below.

At present we have to copy phone links from edit mode as a work around as copying from the normal page brings a speaker symbol.

IE 8 puts up a navigate away from this page warning when buttons are used.

The play page menu is not working in the google wave folder; the playlist message numbers are not added to the messages in the page, perhaps as a result of changing to the .gsm extension to enable playing in the wave gadget.

Autorefresh needs to work and be setable as default being on and every 60 seconds with a warning.

email the page and message needs the picking list to be set up from the email addresses of the contact info for all the enrolees in the site.


buttons

The navigation and Push to Talk buttons shown below are in demo build 86; others such as the option on/off buttons to follow.  We need to consider suitability for a touch screen.

in phone display
Layout is dialpad and a collumn to its right with (stacked vertically) , Status, dial area, dial button,
Hang Up button.   
1  2  3   Status
4  5  6   [             ]
7  8  9   Dial
*  0  #   Hang up
   
NB pre-load the input window with the extension last dialed.
 
In voice controller:-   
[Caller: aaaaaaaaaa  Callee: aaaaaaaaaa]
 Exten: 9999  Msg: 999999  Time-stamp: Year Month Day 23:59:59
 Push to Talk|&   Msg Info   Jump to msg: [               ]   
|||<  ||<  |<<  <<   <   Play/Pause   >  >>  >>|  >||   >||| 
Voice Help = Announcements =  Own Voice =
 Call chitchat   [Play while recording]

Rollovers describe button function and touch tones needed from play mode to do the same as the button.  The voice control keys should always be visible but not lit up if the phone is not connected.

For the message line,
Point here and hold mouse button down to record a message and release to stop recording.  # #
Start and stop recording.  # # [over lock sign]
Starts message information announcement for current message or cancels it.  5 5
Repositions the playlist to the message number provided.  7 (message number)

for the navigation line in order,
First message.  1
Back a day.  313
Back to last.  5 min gap 323
Back one message.  4
Back 8 seconds in the current message.  2
Resume play.  3
Pause play.  3
Forward 8 seconds in the current message.  8
Forward one message.  6
Forward to next 5 minute gap.  383
Forward to next day.  393
Forward to end of playlist.  9

Possible extra button "Forward to latest message. 94" shown below as next to last button on right; last button is then "Forward to end of playlist.  9".

|||<  ||<  |<<  <<   <   Play/Pause   >  >>  >>|  >||   >|||   ||||   


For the options line there should be a "green light" in the button when an option is on (shown above in buttons by =),
Voice Help On/Off.  */00
Message number announcements On/Off.  010/010
Playback of own messages On/Off.  020/020


Note that the message number display could be combined with the jump to message number input area, and this could prompt some redesign of the buttons.  I am not requesting in but mention it in case anyone wishes to champion such a change.

NB we have had requests for a delete feature; ideas?


Additional wish list items to organise


follow

follow should enable the follower to hear what someone else is playing and see what they are browsing as well as annotate what they [or you after following] are listening to

cooperative browsing can operate asynchronously, so what we patented is what happens when the followed has caught up to current in any [verbol] playlist he is playing.

So the playlist is fed through the chatroom as it is played by the followed and played [and navigated] in their own time by the follower because the chat room is recorded and always available for playback

option while following to play pauses or omit them
playing of silences may be suitable for a presentation or a dramatic work as well as music [tracks]


Performance
Performance issue with page duplicates every message causing over usage of storage - implement incremental additions as messages arrive in the page, or just keep the current and a daily start and replay all the messages to recreate a particular page.


player in the gadget

when we are controlling the [verbol] player in the gadget as in Wave, the next play step could do the verbol action appropriate to the next message such as browse or play [determined by verb pattern matching and in its absence by media type].

next message can allow stepping early and we could have a mode where continous play is off so you single step through the messages [by pressing the next button or speaking the next-message command]

for FAQ


How do we position a voice link at the end of a playlist?

Goto_End is a boolean flag, 1 or 0 so the url would be like:
http://demo.verbol.com/pfh-ibook/index.htm?exten=4801&goto_end=1#



IbookInsertMarker: New Text Is Inserted Here