Update on Pingdom Referrer Spam

Update, 11/16/2006: See this comment from Pingdom on the issue. They claim they are tweaking the GIGRIB bot for better behavior and will soon have a working monitoring page on the other end of the referrer. (Preview of that here.)

Update, 2007: Well, the public monitoring page never happened, and Pingdom’s spoofed referrers still forward to their main page. So yeah, they’re still referrer spammers.


My entry on Pingdom’s referrer spam gets a response in the comments from Pingdom themselves:

What Pingdom says:

Crawling the Internet for statistics and information is nothing new. Search engines and other statistical tools have been doing this since the start of the Internet. The referrer link you mention will be leading to a stats page as soon as the service goes live. The page will contain very basic statistics about your site, such as IP address, country of your server, etc. We are not collecting any visitor statistics (this is impossible for us or anyone else to do anyway) or any private information.

I respond to that in the comments, but here it is again just for purposes of clarity.

My response:

The issue, “Pingdom,” isn’t the crawling, it’s the spoofed referrer in the headers. You say that pingdom.com/monitor/whatever.com will eventually point to a working page, but right now it just rewrites to the front page of Pingdom, a page which does not actually link to the site being crawled. So the name of Pingdom and the name of the crawled site are being search-engine optimized in Pingdom.com’s favor in public referrer logs without any current reciprocal link.

That’s referrer spam, and that’s unethical. I would not be complaining about this if the referrer field in the uptime crawler were blank, or led to a current, working page with an actual link to the site, the way the Whois.sc crawler does it. As it is, Pingdom’s in my blacklist, until such time that the monitor link actually returns a real page.

I must add that it’s even worse for Pingdom’s reputation that their monitor bot is working from a server with a questionable history, and hosted by EV1, a company which Michael Pollitt has previously complained about as being lax on spammer activity.

Guys at Pingdom, I’m trying to help you out here. I’m not hating or trying to be an irritant; I’m pointing out where your bot practices are falling short of what people would expect of an ethical company. Uptime monitoring is fine, crawling web content for legitimate reasons is fine, in every way Pingdom appears to be a fine and legitimate service, except for those spoofed referrers. It’s the same reason I’m blocking RSSMicro’s bot.

Other complaints about the Pingdom bot’s behavior on various forums and weblogs follow. A lot of people are having trouble figuring out the purpose of the bot because of the referrer redirect, and are getting suspicious:

Also check out this Google search for the Pingdom referrer string, showing how the spoofed referrer is coming up on public logs everywhere.

On a related note, the original entry on Pingdom is a huge magnet for all sorts of comment spam now, mostly of the standard pharmaceutical and pornographic variety. MT’s spam filters have been catching all of it so far, but it’s interesting that the overwhelming majority of link spam I’ve been receiving is now targeted at that single entry, even more than at my older entries on referrer, comment, and trackback spam attacks.

Polished Wing

Matt’s entry on Flickr “detail” sets got me looking through some of my old photosets, and I found this forgotten gem in Views From Plane Windows, which I had failed to post to my weblog at the time. I think it’s the wing of a United Express / Mesa Airlines CRJ-100 over New Jersey last December:

IMG_4232

I also tried my hand at the fake tilt-shift effect that’s been so popular with the cool photo kids lately, using this photo of the Newark skyline, taken on the same flight:

Tilt Shift Effect, First Try

Diptychs and Cheese Lords

The coolest thing about this Melming diptych is the reflection in the background, which ties both sides together. Amy and I braved rain and wind yesterday to view Prayers and Portraits: Unfolding the Netherlandish Diptych, a new exhibit at the National Gallery. “Netherlandish” in this context refers to the Burgundian Netherlands of the fifteenth century, a somewhat different territorial spread from what we know today as the “Dutch” Netherlands. Diptychs — paired religious paintings on hinges — were favored objects of portable devotion, usually depicting the Virgin and Child or Christ’s Passion, often alongside a portrait of the donor. The exhibit gets especially interesting later in the Renaissance, when mannerist aesthetics gained popularity, so that artists depicted their subjects in poses and settings that the museum literature describes as “histrionic.”

After the exhibit, we watched the Suspicious Cheese Lords sing sacred music of the Flemish Renaissance. As always, the Suspicious Cheese Lords (named for a humorous transliteration of the Tallis motet Suscipe Quaeso Domine) deliver early vocal music flawlessly, every note and every part a deep, multifaceted resonance bubbling up from centuries past. I especially loved their rendition of Nicolas Gombert’s Lugebat David Absalon, which appears to have been based on his secular chanson Je Prens Congie. (I cringed when some n00b in the rear applauded right in the pause between movements. The lesson here is to wait until the music majors clap first, so as to avoid offense to the performer and embarassment to the audience.)

Recent Museum-ing (and Zoo-ing)

In the Beginning: Exhibit of ancient bibles from before the year 1000 AD at the Sackler Gallery. The earliest fragments at the start of the exhibit were what interested me most: a preserved scrap of Dead Sea Scroll, pieces of Coptic manuscripts of John and Matthew, parchments and papyrus and vellum with canonized and apocryphal texts on them alike, in Greek and Coptic and Syrian and Georgian, even a lovely spread from Codex Sinaiticus. The exhibit is wonderfully lacking in the breathless conspiracy revisionism with which “The Da Vinci Code” craze and the more recent “Gospel of Judas” exhibit have been so fond of creating controversy. Rather, exhibit descriptions present the manuscript samples in simple, straightforward history, passing neither positive nor negative judgment on the Bible or its faith, and subtly giving the lie to common fallacies like late authorship or constant change in the text.

The Uncertainty of Objects and Ideas: Recent sculpture at the Hirshhorn Gallery. I wasn’t too fond of the free-standing pieces glued together from “found” objects, but Björn Dahlem was the exception. Very nice radial work.

Constable’s Great Lanscapes: They’re called “great” because they were six feet across and often preceded by oil sketches of equal size, but all in all I didn’t think they were that great. Lots of scale, but up close, not much detail that couldn’t have been experienced if the painting were smaller. One landscape which had had a rainbow added to it at a later date came dangerously close to Thomas Cole-esque mawkishness.

The Streets of New York: American Photographs from the Collection, 1938-1958: Walker Evans’ candid subway shots and Helen Levitt’s photos of children at play made the whole exhibit for me. I was expecting to see a lot more of New York as it was in the last century, but people seemed to be the preferred subjects over urban landscapes.

Asia Trail: The National Zoo’s new Asia Trail is a lovely addition, with large glass-enclosed habitats for Sloth Bears, Small Clawed Otters, and Fishing Cats, and huge spaces for the pandas. The winding paths are conducive to wandering, and the new footbridge makes access to the aviary much easier. I close now with a photo of the small-clawed otters, with a zoom in on the good bits:

Small Clawed Otters

Early Winter for this Tree

(IMG_8726.JPG, uploaded by brownpau.)

Fall is here, and the leaves are turning colors, but it looks like this venerable old elm on the US Capitol grounds can’t wait for winter. (Botanic specialists, correct me if I’m wrong on that tree classification.)

DC General Election 2006

Elections today! DC general elections are rarely as exciting as the primaries, since this is a mostly Democratic town, so it’s sort of given that the Democratic candidates will simply be reconfirmed by the overwhelming majority of voters who gave them the primary slot to begin with. Still, there are wildcards in the equation, the one closest to home for me being the Ward 6 race. I’ll be voting today according to the Smokefree DC General Election Endorsements, which means I select Will Cobb for Ward 6 Council Chair.

DCDL has a list of DC general election candidates with links to candidate websites.

IMG_8720.JPG Update: Okay, all done voting. Here’s how it went: (photo of ballot at right)

House Rep: Norton

Mayor: Fenty

Council Chairman: Gray

Council At-Large: Mendelson, Catania

Ward 6 Council: Cobb

Shadow Senator: Brown

Shadow Rep: Panetta

Board of Education: Bobb, Raymond

ANC6C: Wirt

As a general election postscript, I really love that this is the first thing I see when I come out of my voting precinct:

IMG_8721.JPG

Lazy Pandora in Black and White

The cat’s been a bit ill lately, with a touch of conjunctivitis, coughing, and urinary distress. But she’s getting better now. Here she is in black and white, being adorable and lazy as always:

IMG_8695.JPG

IMG_8699.JPG IMG_8693.JPG

Lost 3.05: Tell The Black Smoke You’re Sorry

I think we’ve established with this episode that the Black Smoke is some kind of telepathically attuned entity which is capable of manifesting as certain persons from a character’s past, possibly via the restoration and reanimation of dead bodies it finds in wreckage. Past LOST storylines have emphasized the importance of a character coming to terms with an internal conflict by finding redemption in forgiveness, repentance, or simple closure. When Eko’s method of coming to terms with his brother Yemi involved a prideful rather than humbly repentant approach, (thus cementing Eko’s reputation as a bad theologian — reference his baptism gaffe) Smoke-Yemi disowned him as a brother. Smack then proceeded to be laid down, ridding the island of yet another actor whose driving had run him afoul of Hawaii’s Finest.

That leaves only one Tail Section survivor in the group, not counting those kidnapped by the Others: Bernard, who has not been seen since the second season finale. What was the point of the whole Tail Section subplot, then? To provide a pool of disposable characters whose deaths could be used to generate TV magazine buzz without actually disrupting the core storyline too much?

I did like the explanation for Eko’s building a church on the island. Originally I had thought of it as a sign that some of the survivors would want to stay on the island rather than be rescued, and he was preparing to provide for their long-term spiritual nourishment, but the revelation that he was instead executing a personal form of penance for his brother (owing Yemi one church) is a far more profound explanation in line with his character development.

While I was prepared for Eko’s death and Ben’s spinal tumor from various spoilers, Juliet’s treacherous Cue Card Message came totally out of left field. Blew me away. Of course Jack’s whole dilemma at this point is whom and what to believe: is there really deathly dissent among the Others, or are Ben and Juliet conspiring to create the appearance of dissent so as to sway his surgical sympathies towards Ben? After all, Ben did say that he wanted Jack to want to operate. On the other hand, certain third-person scenes have shown Ben and Juliet in a subtle power struggle with each other, so she could be upping the ante behind his back. If indeed her cue cards were sincere, Juliet says in her silent message that Ben is a dangerous liar — but this audaciously murderous plan shows her as being fairly dangerous too, as Sawyer pointed out in the previous episode. This should make for an interesting three-pointed conflict as Jack makes his decision.

Subterfuge or no, I really do enjoy Ben’s candor with Jack. His spiel about the whole plan to “break” Jack with an inculcation of emotional investment was an excellent extension of the Of Mice and Men allusion, i.e. “the best laid plans.” One nugget of insight: the plane crash wasn’t a deliberate act carried out by the Others. If the “book club” teaser didn’t put that theory to rest, then Ben’s own profession of the plane crash as a fortuitous act of God should — it wasn’t something he expected to happen.

Yeah, yeah, Pearl Station, Eyepatch Guy, Paulo using the toilet, etc., etc. Thanks to the writers for actually throwing in a few lines to clarify that Paulo and Nikki aren’t part of the “inner circle” that Arzt previously complained about, and throwing them that bone via Locke’s new leadership ethic of inclusiveness. It’s a far better way to introduce the characters than that whiny start Nikki got earlier. Why do I get the feeling that Paulo and Nikki are there as amalgamations of Shannon, Boone, and Ana Lucia, though?

More from Penny Arcade, TV Squad, Easy Does It U, The Tail Section, MostlyMuppet, Nik at Nite, and Moxie.

LOST 3.04: Oh My Darling Clementine

Note: This entry is about the third season LOST episode “Every Man for Himself,” in which Sawyer learns in a flashback that he may have a daughter named Clementine. (Or, possibly, Cassidy was trying to con him using the ruse of a fake child.) Those of you searching for the American folk ballad Oh My Darling Clementine, please look here.

Paulo and Nikki

Remember the Poochie episode of The Simpsons, where alongside the “Itchy and Scratchy and Poochie” story arc, “Roy” suddenly appeared with the family, completely out of nowhere, and was treated as though he had always been around? It was, of course, a gag referencing shows which pull “Cousin Oliver” maneuvers on their audiences, and I got the same feeling from the introduction of Paulo and Nikki. You have Nikki yelling familiarly at Hurley, “When were you planning on telling us this?”, amd Desmond talking golf with Paulo, what’s essentially a day or two after the 2nd season finale. How hard would it have been to have an expository fifteen second “who are you” scene similar to what Ethan or Dr. Arzt got? Maybe Charlie going “Who are those?” to Hurley, and Hurley going, “Oh, that’s Pau and Nikki. They were on the manifest. Cute, isn’t she?” Or something like that.

On Sawyer and Kate

I do believe this is the first episode that I’ve heard Sawyer call Kate by her name rather than “Freckles.” Also, after Kate’s whole second season “I’m sorry I kissed you” heart to heart with Jack, I guess she’s made her decision. Remember how the tension between Jack and Sawyer was a reflection of her own inner conflict over her “good” and “bad” fathers in What Kate Did? I guess she’s coming to terms with being Bad Dad’s daughter.

Psychic Intercom

Juliet says the intercom doesn’t work, but Jack keeps hearing things from it. Wires crossed with Ben’s surveillance system, or is it some DHARMA-induced psychic ability emerging on Jack’s part, manifesting to him via his perception of his surroundings? (That is, he thinks the sound is coming from the intercom, but it’s actually how his disoriented mind interprets its own latent telephathy.) Might be related to his visions of his dead father, and the way the Island has “talked” to Kate and Locke about their tortured pasts via the unconscious Sawyer and Eko respectively.

Another Island

The “pacemaker” con was a brilliant little twist in Sawyer’s character development, bunny and all. But there’s that big question about the “other island” that Ben showed him: how did the Losties miss seeing it? The prevailing theory I favor is that if the island is contained in a closed cosmic loop (what Desmond called the “snow globe”) all one need do is walk far enough to go in a circle — or see the other side of the island.

Killers

“Because we’re not killers,” says Ben. The necks of Charlie and Nathan would beg to differ.

Air and Space Museum Demotes Pluto: Update

More museum news for the Demote Pluto front: in addition to the removal of Pluto from the list of planet symbols, the Smithsonian National Air and Space Museum’s Exploring the Planets exhibit has updated some of its solar system displays to clarify Pluto’s new status as a “Dwarf Planet,” and added an “In Memoriam” poster to explain the classification change.

mo_619_.jpg IMG_8653.JPG

IMG_8655.JPG

Many thanks to the NASM for being frank and sensible about the progress of our understanding of the solar system while also graciously giving acknowledgment to Pluto’s historical status in the course of human astronomical study, and special kudos to the exhibit copywriters for avoiding BTQ abuse.