Archive for the ‘web’ Category

h1

Syndication and consumer internet search in real estate

May 4, 2009

I was asked by Mark Lesswing to give a talk to CCIMLS – the Cape Cod MLS – last week about about “How syndication helps”.  I don’t know all the details of the politics in that area, but apparently the MLS has had to turn off their property search portal due to brokers demands, and the MLS is now fighting demands to also turn off listing syndication to other major search portals.  My notes from the presentation are below.

Side note:  I did the talk over Skype video, which worked surprisingly well.  It’s great when a 10 minute talk literally takes 10 minutes, versus the two days it would take traveling there and back.  The new Skype v2.8 has noticeably better quality and has added screen sharing.  It’s in beta for Mac and you can download it here.

Buyers

The California Association of Realtors (CAR) recently published their annual survey – “2008 Survey of California Home Buyers”.  In former years, this report was called “Internet v. Traditional Buyer Survey”, but they changed it this year.  I think this is an important point – they no longer see a distinction between internet and traditional buyers, as well over 80% of buyers now start their search on-line.  The study found that:

  • Consumers do an average of 6.2 weeks of research on-line before ever contacting a Realtor.
  • 90% of those buyers who use the internet also find their agent on-line.

We also know from other studies that consumers are performing their research on multiple sites.

This aligns with consumer search behavior when researching other large ticket items such as cars and flat screen TV’s – consumers will go to multiple sites like consumerreports.org or cnet.com to research, rather than only visiting a manufacturers site like samsung.com or a store site like bestbuy.com.

Sellers

Want to know:

  • What is the market right now so the home can be properly priced.
  • The marketing plan to ensure maximum exposure of the property.
  • Agent is going to take care of them from start to finish.

If the seller goes to a popular search portal like realtor.com or remax.com and does not see their house listed for sale, that’s going to cause a big problem.

Build

Building a successful real estate search portal takes:

  • Content
  • Technology
  • Marketing (to drive consumers to the site)
  • Business model (to pay for and sustain the site)

Agents cannot do the above, and very few brokers can.  There needs to be a cooperative local effort, led by someone like an MLS, or there needs to be syndication of the content to companies that have done the above and can drive traffic and exposure to those listings.  Some of the MLS vendors – like FBS – are doing work in this area to enable local MLS search portals.

The Shift

Agents and brokers need to shift their focus from simply providing listing data to efficiently managing and nurturing the consumers search, adding value with things like:

  • Local area knowledge (like neighborhoods, schools, community)
  • Current local market knowledge (like pricing trends and competition)
  • Even broader, macro economic and financing trends (like tax credits and financing programs).

Wrap Up

This is what W&R Studios is focused on as a company, starting with our Dwellicious product:

  • Helping consumers to organize, share, and discuss their search for homes.
  • Giving agents and brokers visibility into that process and tools to add value earlier in the research process.
  • Hopefully this gives consumers a better experience and makes agents and brokers more efficient.

Questions?

h1

Mechanize to the rescue

February 10, 2009

If you’re using Ruby to download pages via http, you have a couple of standard choices.  Open-uri is the easiest method, as it abstracts the download and treats it just like a file.  If you need to do something like examine headers or do a POST instead of a GET, you can step down into net/http and be a little closer to the details.

If you need the complexity of sharing cookies across a session and handling re-directs from an MS IIS web server, then don’t spend two days trying to get these two to work like I just did.  Jump straight to Mechanize – just install the gem.  It handled the complex re-directs, the cookie sharing, and both GETs and POSTs with a magical ease.

I haven’t gone any further with it, but apparently Mechanize can do a lot of other stuff too, like find fields and fill out forms.  In combination with Hpricot, it would be a natural for some pretty complex web spidering.

Hope this helps save someone else two days.

h1

Github is cool

September 19, 2008

One of the things I’m enjoying most about Ruby is the energy and sharing that goes on within the community.  Github is turning into the hub that feeds that community.  They bill it as “social code hosting”.  Huh?  Code has never really been a social thing, and the root of github is git – a source code control app – just about the most boring class of software apps there is.  But github offers some innovative new features:

  • every member gets their own space where they can upload their code projects to share with the community, along with the standard profile and RSS feed features you’d expect.
  • search for code you need to complete your own projects and sign up to “watch”, or be notified when any project that you’re using changes.
  • a seamless way to push version controlled code from your desktop to the hub, into either public or private repositories – public repositories are free, whereas privates ones have a reasonable price.
  • and an easy way to fork others code so that you can modify it for your needs or to fix bugs, then push back up to the hub for the benefit of the rest of the community.

Since it went live this year, many very high profile projects have moved to github, including Rails, Merb, Capistrano, Scriptaculous, and Prototype.  In my new project, I am using Will_Paginate, Hpricot, Restful_Authentication, JSON_Printer, and Acts_as_taggable_on_steroids – all downloaded from github.

I was able to add a feature I needed to JSON_Printer, a small project produced by the programmers at TechCrunch, and posted it back to the community.  Just today, I uploaded a new project called NumberTwoPencil which I created to interface with the Education.com API announced earlier this week.  If you have a need for school data in your Ruby app, check it out, make improvements, and share it back with me.  I’m also hosting two private repositories there, code I push every night for backup purposes.

The most popular projects can be seen at http://github.com/popular/watched.  My projects can be viewed at http://github.com/danwoolley.

h1

Useful utility – Jott

July 10, 2008

I’ve been using Jott now for a few weeks and it’s super useful.  You set up a (free) account, give it your e-mail address and phone number, and (optionally) any other friends e-mail addresses who you may want to Jott.  Once set up, you just dial Jott (a toll-free 866 number) and the automated system asks who you want to Jott and what your message is.  You can Jott “myself” or any friends name that you already set up on the web site.  A few minutes later, the recipient gets an e-mail with a text transcription of your message.  The voice to text translation works really well in my experience.

I use this all the time driving to or from work – anything I’m trying to remember, especially to do lists – I just Jott them and then I have a nice list waiting in my inbox when I get there.  Highly recommended.

h1

The Six Phases of Twitter Uptake

July 3, 2008

From my experience.

  1. “That sounds stupid.  Why would I want to use that?  My life is busy enough already.”
  2. “Hey – this is kind of fun, especially at this conference.”
  3. “Man, the web site is down a lot.”
  4. “Cool – using twhirl will solve all my problems.”
  5. “Hmmmm – I guess all of twitter is down a lot.”
  6. “How can I live my life when twitter is f’ing down all the time!?!?!?!?!?”
h1

Twitter business model discussion

May 26, 2008

An interesting post last night by Om Malik regarding possible business models for Twitter has sparked a lot of discussion. Here’s my two cents, and Om’s response.  Join in – either here or over there.

h1

Amazon: “Turn Off Your Datacenter”

March 3, 2008

In my opinion, Amazon is doing more interesting work right now than Google, Microsoft, and Yahoo!, yet those three continue to get more publicity. Here’s a great interview Scoble just did with Jeff Barr, Amazon’s Web Services Evangelist.

View video

h1

Real estate data standards in 2008

January 2, 2008

To start the new year off right, Mike Wurzer composed a great open letter to all the public sites that expose listing data on behalf of brokers – including Yahoo!, Google, Trulia, and Zillow. It encourages the use of common data standards to make it easier, cheaper, and more efficient for brokers to upload listing data and keep it updated.

Right now, brokers have to spend time and money inputting their listing data into the numerous (and growing) consumer sites. If they develop technology to automate getting their data from the MLS or back office systems into one of these public sites, they still have to write code to interact with the API’s and data formats of each site individually. If you want your listings on a dozen sites, you must write code, test, debug, and keep updated with all dozen, and in a dozen different formats. I know that for RE/Max International (we run remax.com and handle around 75% of their US office traffic), the limiting factors for widespread syndication of their listing data has been cost and effort. Right now, we are syndicating listings for many offices to GoogleBase on their behalf, but that project has not been extended to other sites. Instead, it is left up to individual brokers or regions to handle their own listing syndication.

Over the past couple of years, the Schema Workgroup of RETS has done a fantastic job creating new XML schemas for real estate data sharing. The schemas describing listing data are particularly well developed, having been hammered on by MLS staff, MLS system vendors, client vendors, and other technical staff for over a year. Others in the real estate technology space would be well served to utilize this intellectual property – and help the RETS group improve on it – to accomplish the common goal of providing better tools and lower costs to the brokerage community. These standard schemas should easily fit into their current processes, utilizing simple XSLT transformations to convert the standard XML schema into their current proprietary schemas. This small addition to the workflow of a few sites would amount to a tremendous savings on the input side of thousands of participants – the brokers and the MLS’s – and encourage increased participation.

standard electrical outletOnly when we have consistent standards do we see an increase in the creation of tools, increases in efficiency, and lowering of costs. The participation of these leading web sites in the mission of the Real Estate Standards Organization will go a long way toward ensuring adoption of these standards.

h1

Amazon’s Christmas Present

December 14, 2007

SantaAmazon is in a very giving mood this Christmas. They’ve added a new service to their stable of web services, and this is the big one everyone’s been waiting for – Amazon SimpleDB. This is a MAJOR inflection point in web development.

Look – this is beta, it might not work, it might not scale, etc, etc, but Amazon has shown a great track record with their web services (AWS) thus far. First was S3 – storage on demand. Next was EC2 – computing on demand. Lately they’ve added FPS – a flexible payment service, and they’ve had SQS – simple queue service – for a while now. Major sites are running one or more of these services in production right now, sites like New York Times and SmugMug. I even read somewhere that Microsoft is using S3 for storage on one of their sites.

SimpleDB sounds very similar to the CouchDB project I’ve covered in the past. It’s a schema-less data repository of name-value pairs with automatic indexing. It scales instantly, it’s pay per use, and it looks like it uses an API based on REST. Initial commentary indicates it’s using Erlang to accomplish this. More details regarding the API, performance, etc, will come out over the next few weeks as people start to exercise this.

I spend more and more of my time procuring equipement, retro-fitting equipment, dealing with power, cooling, and space issues, budgeting for neeeded equipment, estimating expenditures on future equipment – less and less time building cool stuff. Being able to get up and running in a day on these new services, trying out ideas at low cost, then tossing away bad products or expanding successful products – that’s the future – and it’s all coming into focus right now.

From my point of view, all Amazon is missing now is a proper load-balancing service. I’m guessing that is on tap for them in 2008. If they go the extra mile and make that load-balancer allow geo-graphical distribution of traffic to unique data centers, that would push this stuff into a whole other stratosphere.

h1

The power of del.icio.us

September 16, 2007

Del.icio.us is one of the most useful web sites I’ve started using in the past couple of years. At it’s simplest level, it’s a way to move your web bookmarks out of your browser and into the internet “cloud” so that they are accessible on any computer you use. In the old days (that’s three years ago), you’d bookmark important sites on your office computer, then when you were at your home computer and you needed that site, you were out of luck. Now, with all your bookmarks in del.icio.us, you can get to those from anywhere. The site is free and now owned by Yahoo.

At a deeper level, you can tag every bookmark with keywords and add a description. If you have a lot of bookmarks, this makes them easy to find by a simple search box. In a sense, you’re creating your own little personal search engine – all sites you’ve bookmarked are now searchable by tag and by description. Bookmarks are public by default, but can be marked private for your logged in eyes only.

The format of del.icio.us urls are very straightforward – this is where the real power starts to come into play. To find all sites I’ve tagged with “ruby”, just go to:

http://del.icio.us/danwoolley/ruby

Del.icio.us calls itself “social bookmarking” and this example shows that off – all public bookmarks you make are easily accessible to others. Now when a friend asks you for information about web hosting companies, you can just send him a link that looks like this:

http://del.icio.us/danwoolley/web+hosting

and he’ll see everything you’ve tagged “web hosting” during your web surfing over the past year.

You can even access an RSS feed for these public bookmarks. If someone you trust is always uncovering juicy tidbits about real estate that are worth checking out, subscribe to their feed (for example) using:

http://del.icio.us/rss/donaldtrump/real+estate

Now every time they tag a page using those tags, it will appear in your blog reader.

Rather than a specific user’s bookmarks, you can look at those of the entire del.icio.us user base. Remember, these are sites that have been specifically marked by a human being as having useful information. For specific subjects, this can be even more relevant than general search sites like Google. The site has a very usable UI for searching, but here are some sample url shortcuts you can go to directly:

Sites tagged “web hosting” – http://del.icio.us/tag/web+hosting

Popular sites – http://del.icio.us/popular

Popular sites tagged “ruby” – http://del.icio.us/popular/ruby

As a Realtor, you could do something like tag listings that you’d like your buyers – the Robertson’s – to see at remax.com, then just e-mail them a single link – for example:

http://del.icio.us/debbiesellsboca/Robertson

or allow them to subscribe to a feed in their blog reader – for example :

http://del.icio.us/rss/debbiesellsboca/Robertson

Now whenever you bookmark a new listing and tag it “Robertson”, they will see it. You can even tag other pertinent information you want them to read, like articles about mortgage rates, schools in the area, market conditions, etc, and they will all appear in their blog reader.

If you’re using Firefox, there is a very useful extension available here. It puts a couple of buttons in your toolbar that make it super simple to bookmark any page and bring up your list of bookmarks without having to open the del.icio.us site.

Del.icio.us also has very good developer tools you can read about here. I’ll be showing off one of those in my next post.

Follow

Get every new post delivered to your Inbox.