Content: index_20091002120246.htm
Parent: Brian Reynolds ibook Identity Folder | Copied From 		Contributor: cb
Date: 2009 Fri Oct 02 12:02:46 CDT
Previous Revision | Revision Index

Voice System Road Map


This is the ibook Voice System Road Map

by Brian Reynolds of Family Systems® for Ibook® System V3 adding behaviour to web sites featuring Voicechat implemented by the Ibook Voice System. 

We are at V3.0 build 85 plus a number of improvements to the code on display in the demo and to be released as source build 86.  This is a working document subject to change at any time.

A.  For demo release build 86

Complete remaining navigation buttons with voice control keys always visible, tooltips indicating touch tones, and other demo usability issues as detailed below.

Make Brian's Identity page spawnable on enrolment and enable extension in enrolment form (see bugs below).

Publish sources and licenses.

Publish verbol definitions.

Spawn demo release to several personal systems on laptops and migrate voice.ibook.com to a hosted Family Systems pilot system able to support conference calls.  Freeze demo system on voice.ibook.com?

B.  Core devt stream on demo V3.0 build 87 and onwards:-

0. Finish off any spillover from demo release such as on/off buttons for each option with server confirmation message causing them to show green when on;

a. full topic support and extend usability with additional features such as delete and Voice-announcements.pdf.

b. Improve caller and callee identification, eg if I am called in 801show me as callee, and others we can fix up like calls from Skype.

1. enable group chat roster in the page, along with voice controller and PhoneFH,  my rough suggested layout at Browser-window-layout.pdf.  This permits:-

a. controlling voicechat to this extn from any phone, (this may benefit from a newer version of Asterisk).
and chitchat becomes an option of voicechat. Also own messages go to own identity.
(description Exten 4803 msg 3415 to 3443)
34162: 15:20:10 can voice controller apply to any phone? : Brian Reynolds[Fri Sep 11 10:57:57 2009]<iBot-In> 15:20:14  

b. cooperative browsing, see issued web collaboration patent claims. 

c. verbol scripting and a beginning script to enable a persona to converse and cause its identity to do helpful things; may use HTML 5 Web Worker.

d. Navigating topics and replies. ( Review whether chat makes unecessary the addition of annotation and topics from the voice controller?)

2.  Enable phone in Play List

The play page menu item needs an alternative to generate a telephone playlist and point the phone in use to it, so we can hear and reply in the threaded order.  This would permit us to insert browse commands so a presentation can be created.  And number folders and pages so we can dial into them to play and leave messages. Voice notes from 4801 message 2930 to 2960.

3.  Istamps and Topics Exten 4803 msg 3401 to 3414
3401334: 19:37:20 istamp self link : Brian Reynolds[Fri Sep 11 10:57:57 2009]


4.  enhance chitchat for music, described in voicechat.  See also useful-modes.pdf, SILK and Wideband+VoIP. 
The subject has been changed to:Sat Sep 19 16:45:46 2009<iBot-In>16:45:46 
286087: 16:45:56: Brian Reynolds[Sat Sep 19 16:45:46 2009]<iBot-In> 16:46:01  >>16:46:03
 

NB. All these improvements may be made available as successive builds of the V3.0 demo release.


C.  wider integration possibly in parallel

Follow up on utilising Google Talk, Aim, Skype chat etc?

Integrate transcription services from Google, Spinvox, etc

Search integration including on private pages.

Consider verbol input like Ubiquity and adding our verbol commands to Ubiquity? 

enable use of continuous recordings and ibots creating voicechat in parallel to Asterisk and other recording sources such as Skype with Ecamm.

upgrade Asterisk for V3.1 release,

this can be done by another contributor in parallel to the development improvements listed above, and adopt them when ready. 

It permits personal voice systems with more Digium and third party features such as
fax to/from email
Skype to Asterisk directly with Digium's Skype channel or alternative which may be sufficient for personal system
voice commands (not yet transcription) and text to speech.

We wish to create a packaged system capable of spawning itself and being utilised by anyone with cooperative support.

Also, with transcription, achieve better targeted advertising for conversations or part thereof, eg RG's vision of the Avenue in paris you are talking about coming into view, then its stores and their web delivery etc.

also possibly in parallel by contributors close to their markets, and with possible operational dependency on V3.1

Create and deploy a Facebook version.  Linked-in etc.

Create and deploy a Google Apps version.

Similar opportunities,  see Techcrunch50, Amazon etc.



demo release issues, referred to from A

parameter delimeters
 
Chris just edited the ibook voicechat phone page to pass the params to the iframe src using { } instead of back ticks.http://voice.ibook.com/pfh-ibook/index.htm

Brian looked in the source and found that {} is also being converted and needs setting back and saving while in source mode.  We still have the problem of having to edit the fixups which are more now - is there another choice of delimiter we can use?

problem of phone window being lost behind id or journal window

I tried using the phone in top window of a browse split and think it can help;

I changed the anchor target attributes to ibook for calls to 4801 and 801 in  Brian Reynolds ibook identity :-

After experiencing the split screen by copying the browser url, clicking browse button, then pasting the url, I found:-

Browse without a url should copy the present url into the bottom window rather than have a verbol error.  Also, we need an exit from split window mode.

We need to put a book mark for our controller into the links - what is it?  Then change the message template to use ibook as target with  the bookmark.

Needs an exit mechanism

Good news; repeat clicks are now causing a reload; did you do something?

Bugs

The message number does not show when the phone is called at end; in fact the earlier position shows which is confusing.

Play page without duplicates plays first message repeatedly.  The highlighting also shows up the timestamps in the links rather than in the messages which looks confusing.

Complete updating message template (at present we get extra messages in threaded playlist as the identity link still points to a message rather than an identity).

Fix scrolling to previous location on refresh after form or during and after editing. 
NB the Google Ads seem to position to their top after a refresh, can we stop that?

The extension field in the enrolment form does not pass into the contact info page.  Ensure this automates the VOIP set up.

Navigation issue; when playing after msg 2621 and clicking the |<< button in PFH, it wont back up past message 2621, though using 0220 seems to work.  May be caused by a short message.

Message is hidden by ibook menu when we follow a bookmarked link.

The ibook identity pages such as BR have a link to a parent page Parent: ibook Identities, but this is empty.  The Guest2 identity instead has Parent: Reception Area which has the link View identity ibooks which goes to the same empty page.  This page cannot be edited to add links to the identity pages and editing fails with verbol error.

In JWChat, the windows are mostly too small so the buttons are not visible and there are no scroll bars; in preferences sounds should be turned off by default; we should generate the autojoin of a group chat room for this extension ie from the ibook identity of the page from which chat is launched; the default sizing of the group chat window needs to have a wider contributor list so we can see the actions without messages wrapping and affecting the line below.

At present we have to copy phone links from edit mode as a work around as copying from the normal page brings a speaker symbol.

IE 8 puts up a navigate away from this page warning when buttons are used.

Extra buttons

fixing the above usability issues and adding the extra navigation buttons are high priority, then adding the options on/off buttons as follows.

in phone display
Layout is dialpad and a collumn to its right with (stacked vertically) , Status, dial area, dial button,
Hang Up button.   
1  2  3   Status
4  5  6   [             ]
7  8  9   Dial
*  0  #   Hang up
   
NB pre-load the input window with the extension last dialed.
 
In voice controller:-   
[Caller: aaaaaaaaaa  Callee: aaaaaaaaaa]
 Exten: 9999  Msg: 999999  Time-stamp: Year Month Day 23:59:59
 Push to Talk|&   Msg Info   Jump to msg: [               ]   
|||<  ||<  |<<  <<   <   Play/Pause   >  >>  >>|  >||   >||| 
Voice Help = Announcements =  Own Voice =
 Call chitchat   [Play while recording]

Rollovers describe button function and touch tones needed from play mode to do the same as the button.  The voice control keys should always be visible but not lit up if the phone is not connected.

For the message line,
Point here and hold mouse button down to record a message and release to stop recording.  # #
Start and stop recording.  # # [over lock sign]
Starts message information announcement for current message or cancels it.  5 5
Repositions the playlist to the message number provided.  7 (message number)

for the navigation line in order,
First message.  1
Back a day.  313
Back to last.  5 min gap 323
Back one message.  4
Back 8 seconds in the current message.  2
Resume play.  3
Pause play.  3
Forward 8 seconds in the current message.  8
Forward one message.  6
Forward to next 5 minute gap.  383
Forward to next day.  393
Forward to end of playlist.  9

Possible extra button "Forward to latest message. 94" shown below as next to last button on right; last button is then "Forward to end of playlist.  9".

|||<  ||<  |<<  <<   <   Play/Pause   >  >>  >>|  >||   >|||   ||||   


For the options line there should be a "green light" in the button when an option is on (shown above in buttons by =),
Voice Help On/Off.  */00
Message number announcements On/Off.  010/010
Playback of own messages On/Off.  020/020



Note that the message number display could be combined with the jump to message number input area, and this could prompt some redesign of the buttons.  I am not requesting in but mention it in case anyone wishes to champion such a change.

NB we have had requests for a delete feature; ideas?


 for FAQ,

How do we position a voice link at the end of a playlist?

Goto_End is a boolean flag, 1 or 0 so the url would be like:
http://voice.ibook.com/pfh-ibook/index.htm?exten=4801&goto_end=1#


Additions to organise


Roadmap - follow

follow should enable the follower to hear what someone else is playing and see what they are browsing as well as annotate what they [or you after following] are listening to

cooperative browsing can operate asynchronously, so what we patented is what happens when the followed has caught up to current in any [verbol] playlist he is playing.

So the playlist is fed through the chatroom as it is played by the followed and played [and navigated] in their own time by the follower because the chat room is recorded and always available for playback

option while following to play pauses or omit them
playing of silences may be suitable for a presentation or a dramatic work as well as music [tracks]



Performance
Performance issue with page duplicates every message causing over usage of storage - implement incremental additions as messages arrive in the page, or just keep the current and a daily start and replay all the messages to recreate a particular page.


Verbol player

when we are controlling the verbol player the next button message could do the verbol action appropriate to the next message such as browse or play determined by verb pattern matching and in its absence by media type.

next message can allow stepping early and we could have a mode where continous play is off so you single step through the messages [by pressing the next button or speaking the next-message command]

IbookInsertMarker: New Text Is Inserted Here