Tuesday, April 29, 2008

Collective intelligenceImage via WikipediaAfter my blog post last month, I thought to myself, "Girl! It is SO time to move on. Enough with the 2.0 stuff." With that, it was on to Semantic Web concepts. YouTube has been the most helpful as some of the W3C "tutorials" are, well, a little dry. (Not all of them just some of them.)

Here is a list of some of the videos I really enjoyed:
Tim Berners Lee on the Semantic Web
An Introduction to the Semantic Web
RDFa Basics
Google Tech Talks: Semantic Web

After my head stopped hurting from the first 20 minutes of the Google Tech Talk, I found this article which further explains RDFa.


In his video on Semantic Web (which is his concept) Tim Berners Lee describes what I perceive as being the core of Semantic Web technology. The Semantic Web is a method of knowledge representation coupled with the collective intelligence that seems to be reaching some level of maturity in web applications.

That may seem like a fairly small statement, but there is really a lot going on that makes this possible.

1. Advances in hardware have taken us from Pentium III to Quad core in just a few years. Processing the larger amounts of data with the complex structure of collective intelligence is no longer limited by hardware.
2. Cloud computing allows more developers to focus on collective intelligence problems. There's really no need to spend a day futzing around with server/network crap anymore, unless it's just something that turns you on (and that's ok.)
3. There are enough CS students who see the value in going on to grad studies due to a globalized market for developers.
4. Web technology is finally past the hump of, "gee, look at my cool home page with the spinning

All of these factors are combining to take internet applications past the document.

I could go on, but this blog is starting to get lengthy.

For this blog, I've started using Zemanta. It's a Firefox plugin that makes suggestions for whatever it is that you are writing about. It's showing pictures and links to articles. It's also suggesting tags for this post. I think the content is from creative commons. That's how they get around copyright. The picture I've posted is from Zemanta, but the links are ones that I pulled from previous wanderings.

I realy like the feature that links phrases in the post to wikipedia.



Friday, April 4, 2008

Previously, I wrote about one of my favorite web 2.0 apps, Pandora.

After I wrote that post, I read through a chapter in my new favorite book Programming Collective Intelligence by Toby Segaran.. The chapter was about searching and ranking using a neural net. It greatly reminded me of Pandora. The user inputs the name of an Artist or a song. Each artist/song are entries in Pandora's Music Genome Project which associates each artist/song with different musical characteristics. Pandora will initially suggest music based on these characteristics. That seems like straight-up database to me...bfd. What's interesting is that once the music starts playing, the user has the option to give each song a "thumbs-up" or "thumbs-down." That's training! For most of the semester, I assumed that Pandora must be using a neural network for this training. Then today, I start reading the chapter in Programming Collective Intelligence on filtering documents. There are other ways to train that are not as computationally expensive. This really leaves me to wonder. Aside from pondering the ways in which Pandora is suggesting tunes, I'm very curious about how one would unit test and system test these types of things.

It's been so easy to stick with Web 2.0 concepts this semester. The information I've found about the Semantic Web has been fairly sparse. From what I can tell, it's all about filtering from an extremely wide net. For example,a few days ago, I found out about Zemanta It's a semantic application that suggests content for blogs. The user types along and while they are writing their blog, Zemanta suggests content for the user. The technologies I've looked at for the Semantic web seem to revolve around markup and data representation.

T

Saturday, February 2, 2008

Web 2.0 List, Pandora

This week my assignment is to pick a web 2.0 application and write about what it does and how it works. At first I thought, "I'll just make a big list." But in true internet fashion, I found a really big list made by someone else.

It's a fairly extensive list with categories. There's always the caveat that this is someone else's idea of what constitutes a web 2.0 app, but I saw plenty of regulars on it (facebook, livejournal, etc.)

Pandora is one of my favorites and jumped out at me immediately. I don't get to listen to Pandora very often because it's blocked at work, but I'm always on the lookout for new tunes. It looks like Pandora is now available on mobile phones if you have AT&T or Sprint. I have AT&T so this could be good.

I started playing around with the recommendations Pandora makes and noticed that if I give it Britney Spears, it comes back with "The Teddybears." The Teddybears are a Swedish group from the early 90's who wear giant stuffed bear heads when they perform. I was too busy laughing to notice whether or not the music is at all similar. Perhaps Pandora doesn't quite have recommendations squared away.

After giving Pandora about a week, I eventually found a bug. When I tried to create a station for the band !!! (yes, that's really their name, pronounced chk chk chk) I kept getting gospel tunes. Even though I haven't heard that many of their songs, I could tell that this was not right so I emailed their support. Pandora can't handle a query string made up of punctuation marks.

Esoteric band names aside, Pandora works pretty well. Their help file explains a lot about their technology and how to use the web site. It looks like they start with a basic database query, but also generate metrics about a song based on how many other users liked and whether they thought it fit with the station.

Interestingly, creating a station based on a song is more likely to yield songs with the same type of sound than creating a station based on an artist. I guess that's because an artist can have many phases in their career.

There are other Web 2.0 social music apps. This article from Techcrunch talks about them.

Saturday, January 19, 2008

Defining Web 2.0

Blogging from Miami....YES!!!!!!


My first task is to write a paper all about Web 2.0 as a statement about where we are now. I will definately be moving on to Web 3.0 stuff later, but it's always good to have some perspective and context.

Here is what Wikipedia has to say about Web 2.0 at this very moment on Miami's miracle mile.

This article talks about who is involved: social-networking, wikis, folksonomies

What they are gaining: creativity, collaboration and sharing between users

Since I've never heard the world "folksonomy" before, I searched for that, and saw that it's been suggested the article for "folksonomy" be merged with "collaborative tagging." My best shot at describing whatever "folksonomy" is supposed to be is perhaps as a cloud of people tagging the things they like at different sites on the internet and thereby creating their own cyber-communities through these tags and posts that have something in common. No buzzword here...no, not at all.

Wikipedia also talks about where the term "Web 2.0" came from. Wikipedia says that the term Web 2.0 "gained currency" at the O'Reilly Media Web 2.0 conference in 2004. So I guess it was around before that but nobody really bothered with it. Hmmm....and it looks like Tim O'Reilly wrote a paper to enlighten us all.

The next paragraph talks about how W3C heavy weight Tim Berners-Lee has "questioned whether one can use the term in a meaningful way, since many of the technology components of "Web 2.0 have existed since the early days of the Web."

Well, at this point it doesn't really matter how appropriate or inappropriate the term is because people use it and know what the term is referring to anyway.

Hey! That reminds me, it's time to check my MySpace page...IN MIAMI. Did I forget to mention that I'm very comfortable in my shorts????? My mom said it was snowing in Atlanta today.

Next up...A big fat list of Web 2.0 technologies and an examination of "The Year of the Tag."

Cheers...FROM MIAMi.

Wednesday, January 16, 2008

Introduction

This blog currently provides a record of my readings, thoughts and conclusions for a course-elective independant study I'm completing towards a Masters in Software Engineering. The title of my study is "Semantic Web Concepts and Software Engineering."

My goal for this independant study is to not only obtain an understanding of where Web 2.0 is going in terms of technologies, tools and ideas but to apply that understanding to the field of Software Engineering. I'm simultaneously taking a course in Artificial Intelligence, so I'm anticipating some really great overlap with Web 2.0 and Semantic Web concepts.

Since this is not a structured class with a syllabus that's written in stone, I'll be adding resources as I go along. It's amazing to me how even the resources for a class have changed. Instead of reserved readings and lectures, I'll probably be relying heavily on YouTube lectures from various conferences, Wikipedia, and maybe some blogs.

I'm starting with a more traditional resource, a book called, Programming Collective Intelligence by Toby Segaran

Here is the author's blog

In order to understand where Web 2.0 is going, I will first look at what constitutes the concept of Web 2.0. What are the apps, what do they do, why are they different? How is this a different experience from Web 1.0?

This is a really great video I found on YouTube. It was the opener for the Web 2.0 conference.