« Google Launches gMail | Main | Photo Recognition an Alternative to GPS? »

April 06, 2004

Comments

Denny

Good ideas, but my god, I thought Spam filters were already this smart!

Shannon Clark

The other major issue with all whitelist systems is mail that you WANT, but is not from a human (or is from an address that is unread/piped to /dev/null etc.

The clearest example might be your e-ticket for an upcoming trip.

Others are opt-in mailing lists you join.

Updates/bills from companies you request electronic bills from.

Newsletters/updates from business partners.

the list goes on.

It is a major challenge.

As well, as I was recently going through my address book cleaning it up, I noticed another problem - many systems for spam detection employ a heuristic of "if the sender is in your addressbook allow the message in" - which is very sensible, but also does imply keeping addresses such as mailing lists, as well as other individuals you may not want to contact directly, but from whom you wish to still accept email (competitors for example).

I have also suggested in the past that whitelists based not on direct email addresses but on good vs. "bad" domains + specific addresses might be a way to go.

i.e. yahoo-inc.com which is Yahoo!'s corporate domain might be "good" (email from a Yahoo! employee) while *@yahoo.com might be "bad" - except for individuals whom you already know (or who are known by the network from which you share a whitelist).

This would allow for valid, reliable, ethical "mass" email systems such as those used by major corporations to send out bills, customer updates etc to be allowed, while similar systems used soley for spam would be banned by the network.

Much of the spam I get is from a few major domains (at least listed in the sender) but from a constantly changing address at that domain.

Anyway, good idea wanted to add to the discussion.

Shannon

Nova Spivack

Hi Dave!!! Great to hear from you here. What you suggest is exactly what the new LOAF project proposes -- a way to block spam using social networks as a filter. Do a google search on LOAF and E-mail spam.

Dave Zwieback

The thing with sending a challenge reply to a message with no subject is that it implies that the address is valid, which is all that some of the spammers are sometimes looking for. Your example reply also includes your name (and perhaps other personal information), which I'm sure you wouldn't want to send to just anyone.

Dealing with spam, much like dealing with viruses, is basically a loosing battle. The best thing you can do, is apply a combination of methods. About a year ago, I ghost-wrote a white paper on the most-commonly used spam-fighting methods ( http://www.inkcom.com/zwieback/publications/0303Zwieback.pdf ), if you're interested.

I think that email, useful and ubiquitous as it is, is pretty much dead in its current form. Having had the same email address since 1996, and despite having a powerful spam filter, I still have to manually deal with up to 100 spam messages a day.

I've been thinking that a friendster-like idea would work pretty well for email. For instance, I would configure my email client to only accept emails from people on my white list, as well as those of my friends, business associates, etc. If someone not known to me or my friends sends me an email, I could potentially check out that person's friendster-like profile to see if I want to read the message.

The comments to this entry are closed.

My Photo

Twine | Nova Spivack - My Public Twine items

Radar Networks

  • twine.jpg
  • logo_v5_03b.jpg
  • logo_v5_03b.jpg

Nova's Trip to Edge of Space

  • Stepsedgestratosphere
    In 1999 I flew to the edge of space with the Russian air force, with Space Adventures. I made it to an altitude of just under 100,000 feet and flew at Mach 3 in a Mig-25 piloted by one of Russia's best test-pilots. These pics were taken by Space Adventures from similar flights to mine. I didn't take digital stills -- I got the whole flight on digital video, which was featured on the Discovery Channel.

Nova & Friends, Training For Space...

  • Img021
    In 1999 I was invited to Russia as a guest of the Russian Space Agency to participate in zero-gravity training on an Ilyushin-76 parabolic flight training aircraft. It was really fun!!!! Among other people on that adventure were Peter Diamandis (founder of the X-Prize and Zero-G Corporation), Bijal Trivedi (a good friend of mine, science journalist), and "Lord British" (creator of the Ultima games). Here are some pictures from that trip...

People I Like

  • Peter F. Drucker
    Peter F. Drucker was my grandfather. He was one of my principal teachers and inspirations all my life. My many talks with him really got me interested in organizations and society. He had one of the most impressive minds I've ever encountered. He died in 2005 at age 95. Here is what I wrote about his death. His foundation is at http://www.pfdf.org/
  • Mayer Spivack
    Mayer Spivack is my father; he's a brilliant inventor, cognitive scientist, sculptor, designer and therapist. He also builds carbon fiber trimarans in his spare time, and studies animal intelligence. He is working on several theories related to the origins of violence and ways to prevent it, new treatments for learning disabilities, and new theories of cognition. He doesn't have a Web site yet, but I'm working on him...
  • Marin Spivack
    Marin Spivack is my brother. He is the one of the only western 20th generation lineage holders of the original Chen Family Tai Chi tradition in China. He's been practicing Tai Chi for about 6 to 10 hours a day for the last 10 years and is now one of the best and most qualified Tai Chi teachers in America. He just returned from 3 years in China studying privately with a direct descendant of the original Chen family that created Tai Chi. The styles that he teaches are mainly secret and are not known or taught in the USA. One thing is for sure, this is not your grandmother's Tai Chi: This is serious combat Tai Chi -- the original, authentic Tai Chi, not the "new age" form that is taught in the USA -- it's intense, physically-demanding, fast, powerful and extremely deadly. If you are serious about Tai Chi and want to learn the authentic style and applications, the way it was meant to be, you should study with my brother. He's located in Boston these days but also travels when invited to teach master classes.
  • Louise Freedman
    Louise specializes in art-restoration. She does really big projects like The Museum of Fine Arts in Boston, The Gardner Museum and Harvard University. She's also a psychotherapist and she's married to my dad. She likes really smart parrots and she knows how to navigate a large sailboat.
  • Kris Thorisson
    Kris has been working with me for years on the design of the Radar Networks software, a new platform for the Semantic Web. He has a PhD from the MIT Media Lab. He designs intelligent humanoids and virtual realities. He is from Iceland, which makes him pretty cool.
  • Kimberly Rubin
    Kim is my girlfriend and partner, and also a producer of 11 TV movies, and now an entrepreneur in the pet industry. She is passionate about animals. She has unusual compassion and a great sense of humor.
  • Kathleen Spivack
    Kathleen Spivack is my mother. She's a poet, novelist and creative writing teacher. She was a personal student of Robert Lowell and was in the same group of poets with Silvia Plath, Elizabeth Bishop and Anne Sexton. She coaches novelists, playwrites and poets in France and the USA. She teaches privately and her students, as well as being published, have won many of the top writing prizes.
  • Josh Kirschenbaum
    Josh is a visual effects whiz, director and generalist hacker in LA. We have been pals and collaborators since the 1980's. Josh is probably going to be the next Jim Cameron. He's also a really good writer.
  • Joey Tamer
    Joey is a long-time friend and advisor. She is an expert on high-tech strategic planning.
  • Jim Wissner
    Jim is among the most talented software developers I've ever worked with. He's a prolific Java coder and an expert on XML. He's the lead engineer for Radar Networks.
  • Jerry Michalski
    I have been friends with Jerry for many years; he's been advising Radar Networks on social software technology.
  • Chris Jones
    Chris is a long-time friend and now works with me in Radar Networks, as our director of user-experience. He's a genius level product designer, GUI designer, and product manager.
  • Bram Boroson
    Bram is an astrophysicist and college pal of mine. We spend hours and hours brainstorming about cellular automata simulations of the universe. He's one of the smartest people I ever met.
  • Bari Koral
    Bari Koral is a really talented singer songwriter. We co-write songs together sometimes. She's getting some buzz these days -- she recently opened for India Arie. She worked at EarthWeb many years ago. Now she tours almost all year long and she just had a hit in Europe. Check out her video, on her site.
  • Adam Cohen
    Adam Cohen is a long-term friend; we were roommates in college. He is a really talented composer and film-scorer. He doesn't have a Web site but I like him anyway! He's in Hollywood living the dream.
Blog powered by Typepad
Member since 08/2003