Tools and Intro to P2P Collaboration

OK, after researching, experimenting, and building, I can report on collaboration via P2P.

First, to restate the goal: I want to share family histories and other files, some with just my family and some with the whole world, and do it in a way that we all share the benefits as we each work on our own copies.  Yes, I said "copies": everyone should be able to play with all their data, on their own machine, with whatever tools they choose.  For more sample uses, see familyhistories.info.

Now, a single paragraph for this year in review: after failing to create a workable plugin for one P2P program, I found that all file sharing is not equal, but it's close enough... so it seemed a good idea to make something to cooperate with most file-sharing tools/models.  Thus began P2P-Docs, a program to keep track of your file libraries as well as the other copies of similar content that other people might be working on.  You point it to the files that others are sharing with you ("incoming") and the files that you are sharing with others ("outgoing"), and it will assist you in reviewing and reconciling changes as they get passed around.  It's wrapped with a simple search program, mostly to make it attractive bait for my relatives to be able to search for stories in our shared family histories.  So it feels good to have a deliverable as well as more instructions for actual use.

I've started inviting family and friends to share files.  I hope to have some back-and-forth collaboration before RootsTech 2012.  If you'd like to test out some sharing, contact me.

So... you can see there's a bunch of items that are "not done yet" in my project README.  I want to make these tools and instructions more useful for transferring files.  I'm most excited to give my peeps good tools to search through their information; I love the idea of organizing content by assigning semantics.  It's meaningful work (ha!).  But seriously... someday I assume our computers will parse through all our content and understand it completely enough that it can find everything for us... but even then, we determine what is interesting and important, and we'll apply these values as we search for answers and/or meaning in the electronic records being gathered.  Anyway, if you're interested in any aspect of this, well, interest is what drives what I do, so let's talk.  :-)

A Private Network of Data and Events (used to share family histories, and more)

I'm very excited about the future of sharing information.  Now, there are many projects that help distribute and share your stuff, but there aren't too many that allow you to keep it all to yourself but also share it selectively if you want.  I feel that nuance of private ownership is important: it may not seem like a big deal to let Facebook and Yahoo and Flickr host your data, until they shut down services or delete your account or send your info to the FBI.  I've been motivated by this interview of Eben Moglen published by the P2P Foundation... it really opened my eyes to the possibilities if we were to take charge of our own data on our own machines.

So I'm trying to make my own private network, where my friends share my data and can get updates if they like.

The first use case is for family histories:  I've started collecting histories of my ancestors, and I'm part of an organization with a large family database.  Now, I've put up a search where someone can find histories for people in their own ancestry.  The next step is to enable a text search through those histories, and also allow people to add other histories to the collection... but I've realized that, rather than build a central internet service where people go, I'd like to make it easy for people to have their own copies and use it all in their own private network.  I plan to share history (or even personal) files such that friends will get updates easily, then allow for tagging the history files with genealogical identifiers so that people can pull the ones of interest... and maybe even just pull pieces of data, such as small bits of data that might be part of my own ancestral database.

Does this kind of stuff already exist?  If so, please send me pointers.  If not, this may deserve a name... maybe P2P with events..  P2P3.  :-)

Here are some some other projects and people I'm watching closely:

• anything about the "personal data store/locker"
• Pull by David Siegel
• VRM, information cards
• Google's Data Liberation Front
• Phil Windley, Doc Searls, Dave Winer
• Diaspora (a distributed social network)
• something Sam Curren is doing (dunno what yet)

...

(Wow.  I started writing this to share some concrete ideas, and it just devolved into a general overview with no details; I even published that stuff above, forgetting my original intent.)

Here are my requirements:

• Share files with selected people
• Share groups of files with groups of people
• Share between individuals without the need of any central server
• Notify me about changes to files, and show me just those changes
• Notify me about new files someone has added, and let me choose whether to add it to mine
• Ideally: do the same for bits of information, such as ancestor data found in a history
• Install easily on Windows, Mac, Linux

I don't envision this as a platform for all types of information; it will most likely be less convenient than Facebook and Google... but I hope to help this type of technology mature such that people find it easy and important to store some of their info this way.

So here's my somewhat-more-concrete plan:

• Find some P2P program to leverage for sharing files (AllianceP2P looks interesting)
• Build plugins or something that defines which files to share and with whom
• Manage additions, eg. when a history file is added then my network will be notified of the addition
• Manage updates, eg. when a blog file is updated then my network will be notified of the update and be able to review the change
• Manage changes to linked data (and this part could be really fun), eg. have an ancestor database that notifies me when there's a change to the dataset (RDF?) in the histories in my ancestry while ignoring changes to branches that aren't in my line

Next step:

1. I can use AllianceP2P to define my own network of people and files to share.  Use that as the transport to sync files, and write a local app to detect changes to files and allow me to see the updates.

I'd love to hear your impressions.

Financial Collapse: It's both Wall Street AND Main Street

Lawrence Lessig is promoting the film Inside Job.  I'm glad; it looks like it'll be informative (and hopefully not just emotional).

However, Lawrence says, '... it is crazy—literally crazy—to point to "the losers" as the cause,' where "the losers" are everyday people being bailed out by government programs.  No, it's not crazy: a large part of our financial mess is due to a culture of greed in America, one where people are looking for quick, high returns without looking at the underlying process.  Stocks, securities, banks, and even government bonds all have some kind of risk.  It is unreasonable (an unsustainable) for our society to expect to close their eyes and give their money without understanding the businesses.  There is no guarantee of the future in any aspect of life, and there is definitely no way for everyone to get rich quick.

The only way to build a stable life is to work hard, be committed, and learn constantly.

OK, so not everyone who has lost is guilty.  But it is the prevailing culture in America... or it has been of late.  Let's hope we put that period behind us, rather than blaming some easily-identified targets and leaving it at that.

I'd love to have a local museum! But I'd rather it be voluntary.

A friend of mine just wrote encouraging me to participate in an event that will help raise money and awareness of a local museum. I asked if the museum would be built or supported with taxpare funds. They wrote back:

"For your information, it is mandated in the Bountiful City code that we, yes the people, we have a right and responsibility to record, archive, preserve, and disseminate the history of our community. It is not only proper that we use tax payer money for this purpose, but it is our duty and our heritage to let our children and grandchildren know where we came from and how we got here. All across America we have buildings and lands bought and paid for by tax dollars that tells of the sacrifices of each generation in making America what it is today. If you don't believe this, then don't take your children to a National Park, museum, National Cemetery, or monument, because all of these were and are funded by tax dollars."

My response:

"You are absolutely right: we have many, many buildings, museums, monuments, and lands that are funded with taxpayer money, and I agree that these add to our heritage.

"However, I think even you must admit that our government (especially at the federal level) has frequently spent our money on these things inappropriately. For the sake of one goal (eg. "building heritage"), they benefit the few at the cost of many, and they use government force to do beneficial things which weakens the efforts of those who do good work on a voluntary basis. We can build a much stronger, more resilient community through projects that accomplish these things without force.

"For example, the South Davis Recreational Center and the Rogers Memorial Theater are good examples of burdens that our local Davis county government(s) have imposed or might impose on taxpayers and local businesses, affecting either the free use of their income or the freedom to compete fairly for people's attention.

"Feel free to keep me in the loop. I would love to be part of any voluntary initiative that improves our community like this!"

FYI: I promised to contribute to the next local, voluntary project my friend brings to my attention. Hold me to that. :-) I can't promise that to everyone, but I'll appreciate knowing any of these you send my way!

Clever, Constructive Conversation (About Technology)

Come join us in an open-ended forum about technology.  This is modeled after Phil Windley's CTO Breakfast.  You can see the results of previous discussion here with my event reports.

The difference is the location: we'll do this at venues in Salt Lake City.  Fri Jan 17 2013 is at the Gateway above Jason's Deli, 2nd floor.  (Past incarnations: Max at about 70th S and 13th E; Newmont U at downtown SLC.)

You can count on bagels. (At least, you can at this location; someday we may do it in a cafeteria or restaurant, so be sure to watch the location and confirm whether food is provided or available for purchase.)

As for dates, here is the calendar and here is the iCal info. (For you real-time watchers, follow me on Twitter.)  Afterward, you can see any notes I took in this feed.

If you're interested, you're invited. Cheers!

---

Motivation: amazing things happen when you get together with smart people who speak their minds freely! I've had a great time at Phil's CTO Breakfast events, where many intelligent and well-networked people sit and talk in an open forum about current events and interesting projects and even crazy ideas. In the same vein, the Kynetx conferences have been eye-opening (and mind-blowing), partly because smart people come but mostly because they encourage conversations; they even had 2 "unconference" sessions where the topics and conversations were run by attendees, chosen dynamically (15 minutes before they happened). The experience is always memorable.

I disagree that IP rights are essential.

I disagree that IP rights are essential to growth, at least if they mean strong IP laws like in the US, since those are more often simply used by large companies with lawyers to bully newcomers rather than really building value. Technology nowadays is allowing us to focus on services and reputation, making distribution cheap; to continue to control the ownership of ideas and their delivery is to undermine the foundation of sharing, which is the foundation of the industry addressed in this article.

As an example, technology is enabling artists to spread their art around the world and make money from performances and other more personal approaches. The RIAA fights this with lawyers, which is their right for existing contracts; however, they have yet to show that it affects their business, and the system has also hamstrung many legitimate, innovative uses due to the heavy-handed approaches supported by government force.

Microsoft spread NOT because of IPR but rather due to effective pricing. And today’s service-oriented networks need freedom of open access, not artificially restrictive “property” rights.

There may be a way to create a rational IP system, but needs to be much more narrow and focused than any system in use today.

Why is mandated health a bad thing?

A friend was telling me how they like this health care bill because the insurance companies "can no longer deny anyone with preexisting conditions insurance, something myself and multiple friends have had to deal with. In my eyes, it's completely unfair."

I'm confused... why is that unfair? It's saying we all have the right to force someone else to insure us no matter what our condition. Living is risky and it can be expensive. Government can pass a law for anything, but it doesn't automatically mean there's suddenly enough resources to cover everyone... unless it tries to simply print money, which has it's own set of consequences.

Let's imagine a politician suddenly says, "Everyone has a right to look good," and then passing a bill requiring everyone to go to salons, and requiring every salon to provide a basic cut to everyone who asks. By ignoring the actual needs of consumers and salons, we get imbalance in the stylist economy. Some clients will be happy that they get subsidized cuts; some clients will be overjoyed because a salon is forced to work with them; and some salons will even be happy because they'll give basic cuts at an effective price.

But we can see how the majority of clients as well as most salons will lose out in the long run. We get things like fewer great stylists because there are so many basic cuts required; less salon business innovation for the same reason; and customers who don't even want cuts must still spend time and money for something they don't want. Will we enjoy that society if we're the ones forced to cut people's hair and we cannot control our own business (how much to charge, who to accept as clients, etc)?

The economics of this (ie. forcing all companies to cover everyone or forcing people to buy insurance) skew the reality of supply and demand; in the end they create bigger booms and busts. So we'll be like a friend from New Zealand explained: everyone has basic insurance, but it takes a year to see a doctor... except for the super rich (and politicians) who can afford to pay extra (or get them into elite circles).

Actually, I believe many people would appreciate that kind of society.