Tuesday, October 4, 2011

User Avatars on Cloud Foundry

Most web applications today have the need to upload and serve user generated images such as profile pictures, photos or video thumbnails. If you are using Ruby on Rails there are a couple great frameworks you can use: Namely PaperClip and CarrierWave.

After reviewing both libraries I went with CarrierWave for this project as it seemed the least obtrusive and most flexible. CarrierWave can be used with the file system, Amazon S3 and a database including Mongo GridFS. Since my project is hosted on Cloud Foundry and that gives me free access to install Mongo and bind it to my Application so I decided to try that option.
The first task for which I wanted to add images was when users registered on my app using their Facebook account. Here are the steps you can take to support uploading and serving images. For more details on the Facebook integration review the user.rb model in the source code.

Steps on your terminal

This assumes you already have a Ruby on Rails 3.0 application on Cloud Foundry with a Users model
# Log in to cloud foundry if you are not logged in
vmc login youremail@website.com

vmc create-service mongodb

# See what the newly created mongo service is called
vmc services

# Bind the service to your existing Application
vmc bind-service mongodb-???? appname

Steps on your Code base

1- Add gems to your Gemfile

gem 'carrierwave'
gem 'carrierwave-mongoid', :require => "carrierwave/mongoid"

2- Install CarrierWave for your Model

rails generate uploader Avatar

3 - Edit the generated file

app/uploaders/avatar_uploader.rb
to contain:
class AvatarUploader < CarrierWave::Uploader::Base

          # Choose what kind of storage to use for this uploader:
          storage :grid_fs

          # Override the directory where uploaded files will be stored.
          # This is a sensible default for uploaders that are meant to be mounted:
          def store_dir
              "#{model.class.to_s.underscore}/#{mounted_as}/#{model.id}"
          end

          # Provide a default URL as a default if there hasn't been a file uploaded:
          def default_url
              "/images/fallback/" + [version_name, "default.png"].compact.join('_')
          end
      end

4- Update your ActiveRecord model to store the avatar

Make sure you are loading CarrierWave after loading your ORM, otherwise you'll need to require the relevant extension manually, e.g.:
require 'carrierwave/orm/activerecord'
Add a string column to the model you want to mount the uploader on:
add_column :users, :avatar, :string
Open your model file and mount the uploader:
class User
  mount_uploader :avatar, AvatarUploader

  # Make sure that the avatar is accessible
  attr_accessible :avatar, :remote_avatar_url, :email, :password, :password_confirmation, :remember_me, :first_name, :last_name, :display_name, :username ...

.
end

5 - Create an initializer for Mongoid to use your Mongo DB instance on Cloud Foundry

  • Name it 01_mongoid.rb so it runs before everything else
Mongoid.configure do |config|
  conn_info = nil

  if ENV['VCAP_SERVICES']
    services = JSON.parse(ENV['VCAP_SERVICES'])
    services.each do |service_version, bindings|
      bindings.each do |binding|
        if binding['label'] =~ /mongo/i
          conn_info = binding['credentials']
          break
        end
      end
    end
    raise "could not find connection info for mongo" unless conn_info
  else
    conn_info = {'hostname' => 'localhost', 'port' => 27017}
  end

  cnx = Mongo::Connection.new(conn_info['hostname'], conn_info['port'], :pool_size => 5, :timeout => 5)
  db = cnx['db']
  if conn_info['username'] and conn_info['password']
    db.authenticate(conn_info['username'], conn_info['password'])
  end


  config.master = db
end

6 - Update your CarrierWave Initializer to use the Cloud Foundry Mongo DB

#initializers/carrierwave.rb
require 'serve_gridfs_image'

CarrierWave.configure do |config|
  config.storage = :grid_fs
  config.grid_fs_connection = Mongoid.database

  # Storage access url
  config.grid_fs_access_url = "/grid"
end

7- Handle requests for the images in lib/serve_gridfs_image.rb

class ServeGridfsImage
  def initialize(app)
      @app = app
  end

  def call(env)
    if env["PATH_INFO"] =~ /^\/grid\/(.+)$/
      process_request(env, $1)
    else
      @app.call(env)
    end
  end

  private
  def process_request(env, key)
    begin
      Mongo::GridFileSystem.new(Mongoid.database).open(key, 'r') do |file|
        [200, { 'Content-Type' => file.content_type }, [file.read]]
      end
    rescue
      [404, { 'Content-Type' => 'text/plain' }, ['File not found.']]
    end
  end
end

Step 8 - Deploy !

bundle install
bundle package
vmc update app_name

Conclusion

This will give you the ability to upload and serve images. Do note that this will not provide image resizing. If you are using devise for example you can import the avatar(profile picture) of the user when they sign up.
class << self
    def new_with_session(params, session)
      super.tap do |user|
        if session['devise.omniauth_info']
          if data = session['devise.omniauth_info']['user_info']
            user.display_name = data['name'] if data.has_key? 'name'
            user.email = data['email']
            user.username = data['nickname'] if data.has_key? 'nickname'
            user.first_name = data['first_name'] if data.has_key? 'first_name'
            user.last_name = data['last_name'] if data.has_key? 'last_name'
            user.remote_avatar_url = data['image'] if data.has_key? 'image'
          end
        end
      end
    end
  end

References

Tuesday, November 2, 2010

Activity Streams 101 Session at IIW

For those new to the standard, here is a brief explanation:
Activity Streams is a way of modeling social actions which improves the performance of human beings interpreting shared information and making decisions.

The Activity Streams data structure focuses on:

  1. Providing an up to date digest of important information narrated via the reader's social graph.
  2. Optimizing for human consumption by utilizing multiple mediums in a clean fashion
  3. Producing a cycle of engagement. As reactions to activities occur, those also become part of the stream 
There is also a standard specification which is being developed by a variety of companies and individuals. Here are a few details

  1. activitystrea.ms is a standard used to convey what people are doing around the web
  2. Defines a set of concepts and vocabulary
  3. Can be used with Atom, RSS or JSON
Here are a couple of examples

Activity Streams on Atom


Activity Streams on JSON



Latest News

  • Notes from Kevin Marks
  • Paul Tarjan from FB considers using for Facebook to auto refresh news about the objects in the graph using og:feed
  • OWFa Agreement is getting signed for v1

Monday, October 25, 2010

Microdata guided by usability testing results

About a year ago Google decided to do actual research on how usable the Microdata spec was. This blog post has very interesting details .

Ian Hickson was kind enough to point me to this post after I asked about consolidating the itemscope and itemtype attributes into item.
See:
http://pastie.org/1246677
Here are my comments on their conclusions which you may find helpful:

Tuesday, October 19, 2010

It's official: Socialcast REACH is live

Socialcast (http://www.socialcast.com/) is out of private beta for REACH
http://techcrunch.com/2010/10/19/socialcast-reach-extends-activity-streams-to-outside-business-applications/
for which we parse Open Graph Protocol as well as HTML 5 Microdata with the Open Graph vocabulary.
All of the components are extensible and we will be adding more vocabularies in subsequent releases.
We have been working in private beta with some customers and found that microdata helped us with closed source business systems because it can be placed anywhere on the HTML page.

Side by side comparison:


Pretty easy !

Saturday, October 16, 2010

Context in the Enterprise

Today most people are overwhelmed with information. Not only is there an enormous amount of information to read on a variety of devices, a lot of this information links to other content which takes time to fetch and users end up wasting time if the content is not relevant to them.
Wasting time is something we don't want to be doing ever and guess what ? Our bosses don't want us to do that either. They want us to share and learn but they definitely don't want us to waste time.

With that goal in mind the Socialcast team decided to embark on a mission of providing more context for links which are shared in our application. A small description, picture, title and topics it covers. This practice is not new. Other consumer portals already parse html to try and extract this information.
This is a difficult job because before HTML 5, markup was not inherently semantic.


Most of the tags in HTML were only for layout.
Being the agile team that we are we didn't want to spend a lot of time trying to handle html with tags that are not properly closed and figuring which image is the most appropriate one to render, the representative image, based on size. Too complex.

So we asked what is the best technique for capturing the relevant data in a web page. Our research brought us to the following specifications


What do they have in common ?

All of these are specifications detailing how to add semantic data to your web pages.  The specifications cover the syntax and concepts and in some cases detailed vocabulary.


How many objects can you read out of an html page ?

  • RDFa : As many as you want. You can create new vocabularies and not only describe objects but also entire sentences with subject predicate and object. It also allows cross referencing objects
  • Microformats: All the ones which map to a specific microformat. 
  • Open Graph Protocol : One main object with some predefined relations. The object can have a variety of types specified by Facebook.
  • oEmbed one specified via
    link rel="alternate" type="text/xml+oembed"
  • Microdata: As many as you want and does not enforce global uniqueness or the use of namespaces for types. Objects can be defined adhoc.
     

What is needed to use ?

  1. RDFa: http://www.w3.org/MarkUp/DTD/xhtml-rdfa-1.dtd in XHtml doctype
  2. Microformats: Nothing
  3. Open Graph Protocol: Nothing but it should be same as RDFa
  4. oEmbed: Another document. So performing a separate http request.
  5. Microdata: HTML 5 doctype but doesn't break anything in practice

Initially we just wanted to extract a single object and decided to use the Open Graph Protocol. It provides a short set of rules which on one hand is great because the code to parse it is very short but on the other hand its not flexible enough as described in my earlier post where there are issues working in existing closed source Business Systems.

This is why we turned to Microdata. We have posted on our wiki a lot of details on how the parsing works. How to extend it and we have built the ability for other vocabularies to be used like Activity Streams or even the oEmbed vocabulary can be used.

So what do the users get in return ?

  • Distributed discussions through out their eco system
  • Good sources of material curated by people they trust, their colleagues.
  • Rapid deployment
  • Easy to add to business systems

Sunday, October 10, 2010

HTML5: Implementors experience with OGP and Microdata

You cannot argue the fact that the Open Graph Protocol(ogp) looks very clean and easy to understand.
Its a subset of RDFa which focuses on a single schema and a single location where this schema can be applied:
This is why we started working with it at our company. Simplicity and of course being a standard proposal signed under the OWFa agreement: Open for anyone to use.
So we have been testing interoperability on enterprise software systems. How hard is it to add these ogp meta tags ? For some systems like SugarCRM we have the source code and for some other like Sharepoint we do not.
In addition, our target audience are system administrators, not just developers so we are interested in finding the simplest solution that feels more natural in their environment.
From my experimentation I have definitely found some challenges dealing with this more closed enterprise software. No access to edit the html on the head. No access to dynamic data from the head.

So I decided to try more consumer facing products like wikis, blogs, etc hoping to encounter less resistance.
Today I was testing adding some ogp markup to this blog and found that unlike other systems I have been working with lately it allowed my to easily modify the HEAD.

I added the basic, title, type, etc. However, when it came to og:image I was a bit stuck on what to do even on such a flexible external system.
The images I want featured when I share blog entries with the world will come from each blog entry and will be carefully chosen to capture the essence of the piece.

Naturally the first solution I thought of was Microformats as these can be added in context. The problem with microformats is that they don't have a lot of common properties between the different types of objects.
So one proposal would be to add the concept of a representative image to microformats but in the essence of time I searched some more and remembered something about microdata in HTML 5.
When I first saw Microdata presented I wondered why there was another specification talking about semantics. There is already RDFa... but in taking a closer look I am quickly seeing how useful microdata will be based on its simplicity.

The beauty of microdata is that it does not concern itself with imposing a schema. It does one job and it does it well.

 
Schema is optional. No namespaces. Hurray ! Much more suited for doing inline representation of objects.
Looking at the Open Graph Protocol I realize its more of a schema that can easily be translated into a microdata vocabulary.

Therefore we have now shifted gears to add support in our product for parsing microdata with the open graph protocol as a vocabulary. No more need to hack in semantics. The solution is in the HTML 5 specification. In addition will be rolling our support for more vocabularies based on the needs of our users.

Research:

Monday, May 17, 2010

Extending PubSubHubbub

Yesterday we met at IIW to discuss Facebook's Graph Realtime Api's use cases and why the team decided not to use the current PubSubHubbub specification(0.3). Wei Zhu from Facebook presented some additional arguments to those presented in my earlier post for why PubSubHubbub was not used:
  • Lack of topic URLs. Some notifications can only be pushed and there is no way to GET a list of them at a later time. MySpace had the same issue with the firehose. There was no url for it.
  • One other issue that needs a little bit more work in PubSubHubbub was batching. The current recommendation relies on HTTP Keep-Alives or Atom Feeds.
Here are the ideas we presented that can help solve the issue:
  1. Give every resource a (topic) URL
  2. Use OAuth 2.0 for subscription authorization
  3. Move hub discovery to the HTTP Response Headers

Attendees seem to agree that this is beneficial so we are moving forward with presenting this to the PubSubHubbub mailing list.

Here are the initial changes to the specification:
http://github.com/ciberch/pshb_oauth

I didn't want to put them in the same repo until we got feedback from the mailing list


Facebook's Realtime Updates -- Use Cases

At f8 Facebook launched a first version of real time updates for the Graph API. These updates allow consumers to subscribe to users of their application and get notified via an HTTP Post when the data has changed so they can go and fetch it by invoking the Graph API endpoint.

Some in the community were wondering why the PubSubHubbub protocol was not used and be concerned about issues like the Thundering Herd.

It comes down to these three reasons:
  1. The need for simple data modeling of any resource:
    • PubSubHubbub currently only supports Atom and RSS and we wanted to use JSON to match the rest of the Graph API so developers don't have to write additional wrappers.
    • We need to syndicate changes to any type of resource, not just feeds or lists. The changes may include updating properties of a given resource or deleting the resource altogether. PubSubHubbub only supports appending to the list.
    • The ability to do light pings where only the notification is sent. Not all the use cases require fetching the data right away but can still benefit from the notifications model as opposed to continous polling.

  2. The need for user authorization
    • We needed to let users remain in control over what data is shared and with whom based on their privacy settings.
    • Facebook is committed to authenticity and quality and there are rules to encourage this.
      So one of the main reasons why we could not use traditional PubSubHubbub is that it does not address authenticating the publishers or the subscribers to determine the quality of data being pushed in or the trust that the user has in the consumer.
    • As you may have seen, the Graph API is extremely powerful in its simplicity, flexibility and efficiency.
      To query the Graph API you just need to figure out the url of the resource you are interested in fetching and use OAuth 2.0
      Ex: https://graph.facebook.com/ciberch/feed?token=XXXX
      we wanted to use a similar elegant approach for subscribing to notifications

  3. The need for a more efficient content propagation architecture.
    • For those of you who are not familiar with the term, PubSubHubbub is a open protocol which allows exchange of news feeds in real time by POSTing changes to subscribers as they occur (this methodology is called web hooks). One of the main goals of PubSubHubbub is to allow the syndication of public feeds to any party. It works best when the same content is requested by a multitude of subscribers. For example CNN's feed would benefit from publishing to a hub that can help them service all their consumers. The publisher and the hub do not know or worry about how the information will be resyndicated. PubSubHubbub is built with small publishers and large hubs in mind which allow publishers to fan out. It is definitely a far superior to consumers polling publishers directly.

In contrast to the CNN news example above, Facebook has a more personal relationship with their users.

Here is an example to illustrate the challenge we would face trying to use PubSubHubbub. We have a user *Tim* wanting to share content with to a subset of people and applications and 2 applications: Sports Club and Restaurant Rating Site. The same content can't be sent to both applications because it would violate Tim's privacy.



So what we needed was to provide a simple way for external developers to keep user's data in sync taking into consideration the authorization given by users and thus we selected to use OAuth 2.0 for subscription creation and for data retrieval.


This use case, as well as existing Facebook interaction requirements, materialized in the following three needs:
  1. Need to have a decoupled notification system which allows to syndicate changes to arbitrary data.
  2. Need to only syndicate data to authenticated consumers
  3. The need for a more efficient data propagation architecture.
    • The fact that Facebook only sends notifications of the content that changed means the consumer can always fetch the up to date version from the server. No need to check timestamps in case the updates were received in the incorrect order.
    • The need for Facebook to act as a consumer aware delivery hub distributing the content of a relatively small subset of its publishers to another relatively small subset of interested consumers within a variety of multiple contexts
    • Facebook delivers personlized content to each user on each app and has a lot of users and apps. This means that it would not benefit from fanning out the same content to multiple consumers. Every user and every application gets different updates. In FB's world you see content through your social graph so everyone sees something different.

The PSHB example below does not work for Facebook because it's neither a small publisher needing to fan out nor a traditional consumer agnostic hub. Facebook is only interested in syndicating the updates from Facebook users to trusted parties.



We think that there are other platforms which may be facing similar challenges syndicating changes to arbitrarily modeled data to authenticated consumers.
Before the release of OAuth WRAP and OAuth 2.0 we had some discussions on the PubSubHubbub mailing list about using OAuth 1.0a topic url signing. Here is the proposal. This is a good and simple enhancement and now with the release of OAuth 2.0 we can use a very similar approach.

Sunday, May 16, 2010

Web Linking in JSON

This morning, I have been reading about Web Linking. This is in short a specification standardizing a common practice of making links "fat" with semantic goodness by adding attributes. There is a set of defined attributes and depending on those attributes, more attributes can be added. It's based on xml and comes in very handy for extending Atom and HTML.

Here is an example of how I can reference a related blog post:

<link rel="related"
type='text/html'
href="http://gapingvoid.com/2007/10/24/more-thoughts-on-social-objects/">

The rel attribute is very important as it defines the relation to the current element. There is in fact a registry which takes care of keeping track of all the types of relations. Examples are: me, related, alternate, via, etc. The specification also talks about how to serialize those links on the header but we are going to focus on serializing the links in JSON.

So what happens when we consider rendering feeds in JSON and have to deal with web linking ? While Xml has attributes and child elements, JSON objects only have properties. Therefore attributes and child elements in xml both map to properties in JSON. Structures with properties in JSON are objects. I bet you I am not the first one thinking how should we model an object that has a url to a human readable page in JSON? You may be tempted to simply copy xml verbatim and have an array of links. We actually did this in our Activity Streams JSON specification. It did not look very readable and clashed with our modeling of social objects. It was not clear when to model something as a fat link in a links array or as a native object.

{
"title" : "Web Linking in JSON",
"author" : {
"id": "tag:facebook:2010:0293203920",
"displayName" : "Monica Keller",
"permalinkUrl" = "http://www.facebook.com/ciberch"
},
"permalinkUrl" : "http://montrics.com/blog"
"links" : [
{
"rel" : "alternate",
"href": "http://montrics.com/blog",
"type" : "text/html"
},
{
"rel" : "author",
"href": "http://graph.facebook.com/ciberch",
"type" : "application/json"
}
]
}

Its a mismatch. This "links" is just a bag which can have a large variety of items, so why not just use the links' parent element ? Links are just objects.

Furthermore social objects are fat links with type 'text/html' because they are publicly accessible and human interactive. This is an example of why should not model social objects one way and links independently. They are the same thing. We should represent links in JSON directly as properties where the property name maps to the relationship and type.

For example to list all link rel="related" type="text/html"

{
"title" : "Web Linking in JSON",
"link" : "http://montrics.blogspot.com/2010/05/web-linking-in-json.html",
"related_html_page" : [
{"link" : "http://tools.ietf.org/html/draft-hammer-discovery-05"},
{"link" : "http://openidconnect.com/", "title" : "OpenID Connect"}
]
...
}

Keeping it simple.

Since joining Facebook I have been enlightened by the team's simplicity-first approach to pretty much everything: user interface, APIs and specifications. This vision has had substantial influence shaping external efforts as well: OAuth 2.0 and now we are seeing beginning efforts for OpenID Connect.

The OpenID Connect idea is good and simple: once you know who the user is you will have access to get details about the user in JSON. It's not surprising that JSON is the format of choice for transmitting data. It's compact, takes no effort to deserialize and reads logically.

Another the key ingredient for OpenID Connect is discovery. How do you go from a user's email address or OpenID url to knowing what endpoints to query to get the information ? Eran Hammer-Lahav has been working for several years in Discovery. His work is amazing and inspiring and is becoming the foundation of many of the specifications we use today. In short it's a set of protocols describing how machines can discover and use apis. The one gotcha was that this used to be specified all using xml based on the Web Linking specification so Eran has started drafting a proposal for doing discovery and resource description in JSON called JRD

This is what caught my attention.

Here is what this proposal would look like for JRD using simple web linking in JSON

{
"openid" : {"link" : "https://www.server.com/openid"}
"license" : {"link": "http://example.com/license"},
"lrdd" : {"template":"http://meta.example.com?uri={uri}"}
...
}

I hope this recommendation for modeling links in JSON as objects using the relation is simple and useful and thanks to John Panzer and Martin Atkins for helping shed light on this issue.

Friday, February 12, 2010

This is the story of a girl....

Who came all the way from Ohio to work at MySpace. Starry eyed at the thoughts of millions of concurrent users leveraging software she built, she packed her bags and moved across the country in a jiffy. It was not disappointing.

MySpace was filled with color and character. There were many, many faces all over the amazing complex in Beverly Hills. There were crowded corridors filled with pictures of MySpace Secret Shows and meeting rooms with people excited doing collaborative design. This girl and her friends built the Activity Stream at MySpace and soon realized that it was essential for the stream to flow outside the walls for it to stay alive and thus she embarked on a quest to find a sensible way to exchange this valuable information about users at MySpace. In this quest she found new friends and realized that she truly identified with the values that they were fighting for: letting the user be in control, opening up the walled garden and allowing anyone big or small to have the same opportunities by using open standards.

As you may have guessed, that girl, woman actually is me :) And today is my last day at MySpace. I am filled with nostalgia but excited about the future and pursuing my dreams.

You may be surprised since I have been doing a series of conferences. As Group Architect I was able to not only work with the Activity Stream team but also on the Developer Platform with the backing of the COO, I was able to have my ideas heard and executed. It was these projects which provided massive openness of the user’s MySpace data via Open Standards like OpenID, oAuth, ActivityStrea.ms and PubSubHubbub that filled me with joy because of all the possibilities we provided for other people to be creative.

But I have chosen to leave. While I was able to have some temporary creative freedom this is not the norm or part of what other engineers enjoy and I do not feel there is one cohesive push to deliver the best we can deliver anymore.

To my friends and colleagues at MySpace, some parting advice:
It is imperative that MySpace puts in place strong technical leadership who can attract good technical talent and make well-informed decisions. It is important that they stay connected to rest of the world and work on interoperable standards and solid products which benefit the end user. Many of my fellow engineers have fantastic ideas and a plan for phased delivery.

I wish them the best of luck and I am sure we will cross paths and work together.

If everything goes as planned, I will also be working with more of you in the community and helping showcase and build upon one of the most incredible social products I have ever seen.

Yes that is right ! I am happy to announce that I have decided to join Facebook as an Open Source and Web Standards Program Manager.

I will be working closely with David Recordon, Luke Shepard and another fantastic group of people.

This is going to be a great year. Get ready !

Saturday, December 19, 2009

MySpace Developer Contest

Our apis are so easy and I have a couple ideas for cool apps but:

http://www.myspace.com/developerchallenge says:

>>Employees of Sponsor, their advertising or promotion agencies, those involved in the production, development, implementation or handling of this Contest, any agents acting for, or on behalf of the above entities, their respective parent companies, officers, directors, subsidiaries, affiliates, licensees, service providers, prize suppliers and fulfillment companies, and any other person or entity associated with this Contest (collectively, the " Contest Entities") are ineligible to enter or win this Contest. Household Members and Immediate Family Members of such individuals are also not eligible to enter or win. "Household Members" shall mean those people who share the same residence at least three months a year. "Immediate Family Members" shall mean parents, step-parents, legal guardians, children, step-children, siblings, step-siblings, or spouses. Contest void where prohibited.
Sadnesss ! I could really use the 10K !

If anyone is trying to get a head start on this:
http://www.myspace.com/developerchallenge
And has questions go to: http://groups.google.com/group/myspace-apis

Saturday, December 5, 2009

Answering the real time flow questions before the SuperNova panel

#sn09: We are moving from a Web of pages and sites to a rich continuous stream of online interactions.

@ciberch: Yes our online world is modeling closer the physical world which is immense and filled with streams of events upon events (acontecimientos)

#sn09:This new model snuck on us though social networks and micro blogging, but it is quickly becoming an aspect of the online experience.

@ciberch: The reason why it came from social networking is by no means a surprise. These websites were made to allow the user to be social. Its impossible to be social without introducing yourself . Sites like MySpace allow users to create an online identity and present their virtual face to the world.

User: I like to have a social circle of people to interact with on a variety of topics.

User: You may be far but here is my picture, my name, my overall likes/dislikes

Well in real life the users are not sitting still waiting for visitors to stop by. They are not sitting there repeating the same information over and over. That’s how social networks started…. We know that after the second visit to someone's profile the only thing the visitor cares about is what changed

The need to convey news came from users as a reflection of their lives via blogs, bulletin boards, forums, journals even just changing your picture, theme or display name.

Streams: Close the divide of space but also time

User: I don't really want to go bother everyone right now to tell them what happened but it would be great if they can see this later and let me know what they think.

Lifestream is the new identity: What a user does, how others react

The opinion of someone you trust on a certain topic is the most valuable

One to many disconnected chat

#sn09: How will the flow model alter the business landscape and user expectations ?

@ciberch: When users interact with businesses, they know the businesses have ulterior motives: make money

Users need things from businesses. Adding a social layer to a business will help the user realize the value of the businesses' offering. Adding streams (ratings/reviews) also helps businesses provide the identity/value of a product. Similar to the lifestream for a thing. Also on the reverse businesses will look at individuals public lifestream to reflect the person's character and potentially make some decisions based on that.

Therefore, it is important to be able to exchange these streams. Users don't do everything in one site, the same way as users don't just go to one store or eat one restaurant or live in one town for the rest of their lives.

We still are living in the midst of the information age. Information and knowledge inevitably equates to better decisions: better responses and better communication.

Humans are social by nature and empowering them with the information to make their social interactions more precise is very valuable.

Another aspect of humans is the desire to self express and contribute thus asserting their value. With this goal in mind many of us have spent hours and hours building personal web sites, blogs, taking pictures, videos, writing songs. They want to be discovered and places like MySpace with the stream allow for this happen.

Finally another aspect of humans is their competitive spirit and desire to surpass others in some particular areas. To be recognized as creative minds or reputable curators of content and share important information

The availability of information levels the playing field and builds meritocracies. Anyone can learn, analyze, comment

Shared development, collective intelligence. On demand indexing and correlating

It is the only way we can process this mass of information, conquer it together and evolve



What actually happened was here:
http://www.ustream.tv/recorded/2695517

Friday, October 2, 2009

Expense Training Lesson

So I have about 3 months of expenses to be reimbursed by work. Most of them are taxi receipts from SFO to work and to different meetups. I have been told I need to attend a lesson to finish submitting my expenses.
I am sitting here listening to the Oracle expert tell me I need to use IE for the best experience on their new finance tool. Funny to hear companies are still so into IE
IGN guy is annoyed the lesson is MySpace specific. I am now done eating Meghan's delicious pumpkin cake and tapping my leg wanting to leave.
No single sign on -- lame

Sunday, September 27, 2009

Sf vs LA

I am contemplating moving SF soon so I can be in the same city as @n2frizbee and be able to properly plan our wedding and the rest of our lives.

The only problem is that i have made so many friends here in LA and at MySpace that its really hard to think of not seeing them again.

Even through the harder times when everyone is bitching we find ways to laugh it off and pull through it.

I guess LA is more of a city for single beautiful people. SF is a city for smart friends and more family values.

It would be so cool if I could take my sister Mary with me.

Sunday, August 30, 2009

Cerebral Snapshot

Left

  1. Man on Southwest Flight 3149 from LAS to LAX: I repeat you cannot save seats. Much less 6 seats with a full plane !
  2. Taxi drivers are really nice when the economy is shit. Today one offered be complimentary bottled water... (I didnt accept it but gave him an extra buck)
  3. Vegas is the best quit smoking plan -- cough cough -- so that's where all the smokers went
  4. Damn I accidentally bought an Ed Hardy shirt....
  5. Eating Healthy Choice Tortilla soup when temperature im my apt > 85F is a bad idea

Right

  1. The only way to scale is to be redundant.
  2. Semantics are king
  3. Progressive enhancement means Microformats and ActivityStrea.ms
  4. You must inject the microformats server side
  5. Don't bother exposing an API full of GETs

Sunday, August 23, 2009

OpenID Registrars

Recently I saw Mr. Messina's mocks for teaching the user what an OpenID is and how to get one or use an existing one. See http://www.flickr.com/photos/factoryjoe/3841182425/

I feel that this is still complicated for a regular end user. They just want to log in or signup for the new service as fast as possible.
The open id relying party should be able to just show the user their openids with the last one they used selected so the end user does not even have to bother typing anything if they don't want to.

I would like to propose a potential solution to this. When a provider creates an openid for a user they register it with an "OpenId Registrar". The OpenID registrar will cookie the user.


An OpenId Registrar keeps track of all the identities a user has. It will have APIs similar to the Social Graph Apis from Google. Given one OpenID from a given provider you can get the rest. This can also be supported via webfinger. Given an email address give me all the openids for the person. And with the help of the cookie it can say give me what openid provider I should present to this user.

So the way in which having an OpenID registrar would solve the NASCAR issue is that it will provide an API which returns the list of OpenIDs for the user on that browser and the last one used. Which means the registrar should also have an endpoint which can be invoked to store which provider was just used.

Fairly simple but should address end user confusion.

What do you think ?

Saturday, June 6, 2009

MySpace comeback

  1. Make a huge public contest/tv series "Who will be the next Tom ?" Episodes will show contestants every day life and how they portray this on MySpace. TV show will also demonstrate how to do cool things to your profile page and link to videos on the site teaching you the tips and tricks.
  2. Users of MySpace follow and vote online for the Next Tom
  3. Create a secondary contest to pick the best profiles. This contest will include challenge questions to make sure the applicants are "for real".
  4. Select multiple winners each representing a different audience.
  5. New Toms will be VIP
  6. The real people from #3 will get a list of challenges to defeat to become VIP
  7. Vips will not get ads on their profile page or can have their own adds.
  8. Developers from MySpace will add modules which allow you to show your friends across all networks.
  9. Vips will be able to nominate 5 friends for vip. These people will have to face the challenges and can then invite more friends.

And so the user cleansing continues until you have a site with awesome members excited about bringing others on board and a true understanding of why the people are here.

Why MySpace ?

MySpace started off helping those looking to self promote. Primarily bands. They could easily setup "their website" on MySpace.
I think there is now an even broader market for self promotion. Everyone wants to be a celebrity in their own right. Whether you are well known for your musical talents or for your basketball skills or for how ridiculously good looking you are (zoolander joke there). Whatever the reason you are a proud individual with ideas, accomplishments and things to share. This is a time to prove yourself !

MySpace can provide an immense personalization layer. Our users can really "go to town" expressing their individuality via their MySpace profile with: custom art, media and other rich content including information from other sites. This is not something that you can easily do on Facebook or Twitter. They just list a partial set of activities and maybe allow you to change your background. MySpace however allows you complete control of everything displayed and how its displayed.

You may not always have the time or creativity that is why we have many tools to help you build your personal brand. Our offering has hundreds of pre built themes and modules of content you can add in two clicks. You can definitely use MySpace as your personal web page and remember if you look good we look good !

Tuesday, May 26, 2009

Web Evolution: Implementors Needed !

My response to:
Web 3.0 Might Be Really Stupid

Given that the first implementations of the activitystrea.ms standard went live about 2 months ago. I think its premature to call the lack of analytics around this new offering stupid. The analytics are evolving and many of those will be feeding into the recommendations engine. There is a lot of opportunity in this field.

As described in this recent article exploring how friends influence purchases
>> "Moderately connected" users exhibit "keeping up with the Joneses" behavior. On average, this social influence translates into a 5 percent increase in revenues.

Additionally, we should not shy away from investigating hyper targetting and ad placement models. After all every item in your activity stream can be considered a personal ad that you want your followers/friends to read. How to make it more memorable ? How to get the user to interact ?

Incidentally, I was just mentioning to Chris Messina last week that the Activities team at MySpace has already gotten initial approval to provide a user's public activitystrea.ms feed in order to encourage adoption. And no, not because no one wants to consume MySpace's feed.

We have several large partners and don't forget the fact that MySpace has more than 70 million total unique users in the US (as of the March 2009 comScore data). However, I do agree a public feed would provide more portability so we are reviewing this proposal.

Bottom line is we are doing everything possible to promote a smarter web and we need everyone's collaboration. Whether its producing smarter feeds or consuming this feeds and creating another consumable a bi-product. Stop pondering on how far others will get and jump on the implementors side.

Saturday, May 23, 2009

Collaboration of Opensocial apps via the Stream

Last week at IIW #8 Scott Seely, Martin Atkins and myself worked to add the hooks to the Opensocial APIs (0.9) in order to facilitate developers adding the full fidelity version of their activities into the stream.

The results of our collaborative brainstorming is here:
http://wiki.activitystrea.ms/OpenSocial-Activity-Publishing-Integration

The main concept behind this was to allow developers to reference an optional tranformation bundle which maps the fields in the activity raised to the proper objects in activitystrea.ms like for example the author, verb, object type and most importantly all the properties of such object: unique id, name, annotations, url, thumbnail, etc

The main pros of this approach is that it allows for the activitystrea.ms standard to evolve orthogonally.

All this led me to thinking:
Could we in fact provide such flexibility to our app developers where their products (the activities) could cross reference one another ? After all the ids are gobally unique. WHy could we not have the activities from one app reference the object of another domain ?

Imagine this scenario:

John Mayer Vanderbilt show on May 22nd 2009 photo stream
  • Deb loves the new look on John >> from IFan Just Now
  • Monica is wondering why John takes so long ! >> from Ticketberry 2 minutes ago
  • John is getting ready to go on stage >> from IRockstar 4 minutes ago

Similar effects have been achieved with machine tags however there is no need for that given that the activities stream provides global unique identifiers. Surely one can produce a consumer which can leverage this and properly group based on the object id ?

social coder

My photo
San Francisco, California, United States
Open Web Standards Advocate