Archives

Categories

The AP and Copyright on the Web

The New York Times has an article about the Associated Press (AP) trying to gain more control over material that it distributes [1]. The article is not clear on the details.

One noteworthy fact is that the AP apparently don’t like search engines showing snippets of their articles. This should however be an issue for the organisations that license the AP content and redistribute it (newspapers etc), they can use a robots.txt file on their web server to prevent search engines from showing snippets of their content – then once their traffic drops dramatically they can threaten to boycott AP if they can’t do things properly. Speaking for myself the majority of the articles I read on major news sites come from Google results, if they stop Google from indexing AP content then I will read a lot less of it. The end of the article says that there is some sort of battle in Europe between Google and newspapers. Has Google stopped respecting robots.txt? How can this be a problem, if someone copies the entire article you can sue them and you can ask Google not to index your site. That should cover it.

The AP will be going after sites that copy large portions of articles, but this is not news at all. I often see web sites copy my blog content in ways that breach the license terms. As I’m not well equipped to deal with such people I usually try to find an instance of the same splog (spam blog) copying articles from a major news site and report it to employees of the news organisation. They can often get the splogs shut down, sometimes rather quickly.

They are apparently after SEO, they want to get the top entries in search engines for their articles and not have a site that paraphrases the article or quotes it. I don’t think that my blog posts which paraphrase and quote from mainstream media articles are likely to do that, but the newspapers have to deal with the fact that when Slashdot and other popular sites reference their articles then they will lose on SEO. They should be happy that they can win most of the time.

Brendan Scott has a rather harsh take on this [2] which he unfortunately has not explained in any detail. The people who write the news articles for AP get paid for their work and then AP needs to get paid to run a viable business – which is in the public interest. It may be that the AP are doing something really bad, but the New York Times article that Brendan cites doesn’t seem to support any such claim.

Fixing the Correct Network Bottleneck

The latest news in the Australian IT industry is the new National Broadband Network (NBN) plan [1]. It will involve rolling out Fiber To The Home for 90% of the population, the plan is that it will cost the government $43,000,000,000 making it the biggest government project. Kevin Rudd used Twitter to say “Just announced biggest ever investment in Australian broadband – really exciting, infrastructure for the future” [2].

Now whenever someone says that a certain quantity of a resource is enough you can expect someone to try and refute that claim by mentioning that Bill Gates supposedly stated that “640K is enough” when referring to the RAM limits of the original IBM PC. As an aside, it’s generally believed that Bill Gates actually didn’t claim that 640K would be enough RAM, Wikiquote has him claiming to have never said any such thing [3]. He did however say that he had hoped that it would be enough for 10 years. I think that I needed that disclaimer before stating that I think that broadband speeds in Australia are high enough at the moment.

In any computer system you will have one or more resources that will be limited and will be bottlenecks that limit the overall performance.  Adding more of other resources will often make no difference to performance that a user might notice.

On the machine I’m using right now to browse the web the bottleneck is RAM.  A combination of bloated web pages and memory inefficient web browsers uses lots of memory, I have 1.5G of RAM and currently there is 1.3G of swap in use and performance suffers because of it.  It’s not uncommon for the machine to page enough that the mouse cursor is not responsive while browsing the web.

My options for getting faster net access on this machine are to add more RAM (it can’t take more than 2G – so that doesn’t gain much), to use more memory efficient web browsers and X server, and to simply buy a new machine. Dell is currently selling desktop machines with 2G of RAM, as they are 64bit systems and will therefore use more memory than 32bit systems for the same tasks they will probably give less performance than my 32bit machine with 1.5G of RAM for my usage patterns.

Also the latest EeePC [4] ships with 1G of RAM as standard and is limited to a maximum of 2G, I think that this is typical of Netbook class systems. I don’t use my EeePC for any serious work, but I know some people who do.

Does anyone have suggestions on memory efficient web browsers for Linux? I’m currently using Konqueror and Iceweasel (Firefox). Maybe the government could get a better return on their investment by spending a small amount of money sponsoring the development of free web browsers. A million dollars spent on optimising Firefox seems likely to provide good performance benefits for everyone.

My wife’s web browsing experience is bottlenecked by the speed of the video hardware in her machine (built-in video on a Dell PowerEdge T105 which is an ATI ES1000). The recent dramatic price reductions of large TFT monitors seem likely to make video performance more of an issue, and also increases the RAM used by the X server.

Someone who has reasonably good net access at the moment will have an ADSL2+ connection and a computer that is equivalent to a low-end new Dell machine (which is more powerful than the majority of systems in use). In that case the bottleneck will be in the PC used for web browsing if you are doing anything serious (EG having dozens of windows open, including PDFs and other files that are commonly loaded from the web). If however a machine was used for simply downloading web pages with large pictures in a single session then FTTH would provide a real benefit. Downloading movies over the net would also benefit a lot from FTTH. So it seems to me that browsing the web for research and education (which involves cross-referencing many sites) would gain more of a benefit from new hardware (which will become cheap in a few years) while porn surfing and downloading movies would gain significantly from FTTH.

The NBN will have the potential to offer great bi-directional speeds. The ADSL technology imposes a limit on the combination of upload and download speeds, and due to interference it’s apparently technically easier to get a high download speed. But the upload speeds could be improved a lot by using different DSLAMS. Being able to send out data at a reasonable speed (20Mbit/s or more) has the potential to significantly improve the use of the net in Australia. But if the major ISPs continue to have terms of service prohibiting the running of servers then that won’t make much difference to most users.

Finally there’s the issue of International data transfer which is slow and expensive. This is going to keep all affordable net access plans limited to a small quota (20G of downloads per month or less).

It seems to me that the best way of spending taxpayer money to improve net access would be to provide better connectivity to the rest of the world through subsidised International links.

Brendan makes an interesting point that the NBN is essentially a subsidy to the entertainment industry and that copyright law reform should be a higher priority [5].

Australian Democracy is “Microsoft Compatible”

Here is the Australian Electoral Commission documentation on how to register a political party [1]. It includes the requirement for “A Microsoft compatible electronic membership list (and paper copy) providing the following information“.

So a prerequisite for registering a political party appears to be the ownership of a PC running Windows. While it may be the case that I could create a plain text file on a Linux machine and append some CR characters to each line, or create a CSV format spread-sheet/database file the most common interpretation of this is likely to be that MS-Office is required.

Such blatant promotion of a software vendor in a government document is unacceptable. Anyone who wishes to use other software for their political activities should be permitted to do so without restriction.

Fads and Internet Services

Richard Glover has written a polemic about fads on the net [1]. His points are essentially good, but he does over-reach them a bit (which is part of the polemic style) and he also seems a little unimaginative about the future of technology. He starts by suggesting that Twitter [2] is a fad. Twitter has grown in popularity very rapidly, and I believe that the company is not guaranteed to last forever (the business model could fail or a better implementation of the concept could take the users). But the basic premise of Twitter (SMS length messages being published on the net in a similar manner to blog posts) is something that has been proven to work well. So even though I have not felt inclined to use Twitter (either as a reader or a writer) I don’t think that the class of service will ever go away.

He also cites an example of watching TV news on a mobile phone. While I believe he is right about that not being a viable business, it’s because TV news itself isn’t a great thing. Before the Internet was commonly used the only ways of getting news of something that happened in the last few hours was via TV or radio, if you want pictures with that then TV was the only option. If you wanted quality news (in-depth coverage, insightful analysis, and a depth of detail) then you were probably out of luck, but the best option available to you was the the newspaper. Watching a TV news segment on a mobile phone (or on a PC connected to the net) is not effective. What I want is a newspaper that is updated as soon as events happen and which contains full color pictures and video. There are a number of web sites which provide this service, The Sydney Morning Herald (which employs Richard Glover) [3] is one example.

I think that the current fad for mobile phone TV is like the fad for WAP [4]. Many years ago I worked for an ISP that installed a WAP server, one of my duties was to keep the WAP server running. Everyone who knew anything about technology knew that the project was going to fail, WAP phones were horribly expensive (you could expect to spend an extra 200 guilders or more to buy such a phone) and the features of WAP were not particularly exciting. Also requiring that everything be re-written for WAP was just insanity. The problem with the WAP fad was managers who knew nothing about technology making technical decisions. I’m sure that the TV on mobile phone fad is driven by managers in TV companies that are greedy for more revenue opportunities and don’t stop to think about the implications. I might watch a news show on free TV, but I’m certainly not going to pay by the minute to watch it on my mobile phone. Instead I can just go to a web site such as the SMH and read news items, see pictures, and even watch the occasional video (most TV news doesn’t really require any video – they just re-enact scenes or use stock footage to have something on screen).

Finally he makes a sarcastic reference to chocolate fondue. That reminds me, someone gave me a fondue set years ago that I haven’t used yet. I’ll have to make a chocolate fondue! For those of you who live in Melbourne, the restaurant of the Melbourne Swiss Club [5] offers cheese fondue for the main course and chocolate fondue for dessert. Fondue is still with us!

Real-World Car Safety Tests

The car safety tests that are required for every new mass-market passenger vehicle are flawed in many ways. Here is a list of the most obvious flaws (please point out any that I’ve missed):

  1. There has been no research to make accurate crash-test dummies to represent women and children, and I believe that there has been no research to make crash-test dummies to accurately represent people of racial groups that are not common in the US. Basically the medical research used to make crash test dummies was performed on male cadavers that were readily available in the US.
  2. The standard tests involve a direct collision with a centrally targeted stationary object, a direct collision with an offset stationary object, and solid objects (representing cars) hitting the vehicle from the read and the side. These simulate crashes where there is little or no attempt made to avoid the collision, they are probably really good for protecting drunk drivers. But any sane and sober driver is probably going to make some effort to avoid the collision and the resulting impact will not be at a multiple of 90 degrees. Note that when a car directly hits the side of a moving car it is quite different to hitting the side of a stationary car (which is what is tested).
  3. There are no standard tests for the probability of a vehicle rolling in the event of a crash or of what would happen to the occupants if it was to roll. Rollover crashes are among the most dangerous…
  4. The tests do not take into account the ability of the driver to avoid a crash or minimise the damage. The ability to avoid crashes is a major advantage for cars with a low center of gravity, AWD, and traction control. It’s a major problem for vehicles with a high center of gravity and with tires that are not designed for road use (IE 4WD/SUV vehicles).

But generally the crash-test results are of some use provided that you start by looking at the results from vehicles that have good safety features such as the Audi Quattro, the AWD version of the VW Passat, a Mercedes with 4MOTION, or any other vehicle with constant four wheel drive, road tires, four wheel traction control, and a low center of gravity.

The RACV (the main car owners advocacy organisation in Victoria and also a major car insurance company) [1] has published the used car safety ratings report [2]. This was produced by the Monash University Accident Research Centre and is based on the analysis of 3,000,000 crashes reported to police in Australia and New Zealand. Results are only available for cars which have been in common use on Australian and New Zealand roads for some time (so there aren’t many entries for vehicles that are less than 5 years old or for particularly expensive vehicles).

The report also includes estimates on the purchase prices of some of the safest vehicles. A vehicle that is significantly better than average can be purchased for as little as $5000!

Now if you want to buy a new vehicle then choosing the latest version of a model that has rated well on the used-car tests should be safe if the new car crash tests also report good results. It seems likely that the latest Mazda 6 or VW Passat will also rate well on the used-car tests in a few years time. It’s a pity that the report didn’t note which of the vehicles that rated well have models that have good features to avoid collisions such as EBA, ABS, AWD, and traction-control.

A friend who is active in the free software community recently had a very lucky escape from a significant crash. From his description I doubt that car safety features had much to do with him escaping without injury, I think that it was mostly luck. While his car did have a good range of safety features (and was rated well on the used-car tests), a high-speed collision that involves a truck can easily result in a car being squashed flat. I have already sent him the RACV link which he is using as part of the process to decide what new car to purchase. But I think that this information needs to be spread more widely.

I have not searched for information on such analysis of crashes being performed in other countries, please leave a comment if you know of any good research that will be useful for other people. One thing to note however is that given the global scope of car manufacturing, results from one country will have some validity in others. I expect that a VW Passat that is sold in Germany or the US will be almost identical to the Australian version.

Tithing for Open Source

It’s common to hear a complaint of the form “I get paid to keep computers running not hack an OS” coming from someone who uses an Open Source OS such as Linux, BSD, or Open Solaris.

It seems to me that part of the job of keeping computers running when using Open Source software IS to hack the source and fix bugs. This takes the place of praying, begging, and having your employer pay arbitrary extra amounts of money to the vendor when you have problems with proprietary software.

It’s well understood that a good system-administrator will anticipate problems and implement solutions to them in advance. You don’t wait for a system to run out of disk space and then fix it – you install cron jobs to compress and remove old log files and have a monitoring system to tell you if disk space really runs low.

It seems to me that the approach that many companies take towards fixing software bugs goes against this ideal. They wait for software to fail in production and then file a bug report and hope that someone else will fix it.

When allocating time for various tasks it’s not uncommon to have various amounts of staff time devoted to different servers, departments, or projects. I believe that having a fixed amount of time devoted to finding and fixing bugs in Open Source software (both current versions and pre-release versions) would save money for a company in the long term. If 10% of the time of the most skilled programmers was assigned to finding and fixing bugs in the OS then the overall quality would improve. If a company depends on Debian then it would make sense to have this 10% time include testing out the production programs on Debian/Unstable, it if depends on Red Hat Enterprise Linux then it would make sense to test them out on Rawhide. This would increase the ability of the future releases of Debian or RHEL to support the applications in question, and might also discover some application bugs.

Also it’s very important to submit patches with bug reports. It’s not uncommon for a bug report to be critically important to a user but not overly important to the rest of the world. Such bugs can stay in a bug tracking system for a long time without getting fixed. But if there is a patch submitted that includes necessary documentation patches and a description of the tests that it has passed then it will probably be easier to include it than to debate whether it’s really needed.

If a project is only running for a matter of weeks or months (EG a consulting company that comes in, deploys a “solution” and then leaves) then there is probably no benefit for doing this. But if a company is going to be running servers for many years which will periodically be upgraded then it would be a real benefit to have bugs fixed in future versions.

Google Server Design

Cnet has an article on the design of the Google servers [1]. It seems that their main servers are 2RU systems with a custom Gigabyte motherboard that takes only 12V DC input. The PSUs provide 12V DC and each system has a 12V battery backup to keep things running before a generator starts in the event of a power failure. They claim that they get better efficiency with small batteries local to the servers than with a single large battery array.

From inspecting the pictures it seems that the parts most likely to fail are attached by velcro. The battery is at one end, the PSU is at the other, and the hard disks are at one side. It appears that it might be possible to replace the PSU or the battery while the server is operational and in the rack.

The hard disks are separated from the motherboard by what appears to be a small sheet of aluminium which appears to give two paths for air to flow through the system. The thermal characteristics of the motherboard (CPUs) and the hard drives are quite different to having separate air flows seems likely to allow warmer air to be used in cooling the system (thus saving power).

Google boast that their energy efficiency now matches what the rest of the industry aims to do by 2011!

The servers are described as taking up 2RU, which gives a density of one CPU per RU. This surprised me as some companies such as Servers Direct [2] sell 1RU servers that have four CPUs (16 cores). Rackable systems [3] (which just bought the remains of SGI) sells 2RU half-depth systems (which can allow two systems in 2RU of rack space) that have four CPUs and 16 cores (again 4 CPUs per RU). Rackable systems also has a hardware offering designed for Cloud Computing servers, those CloudRack [4] systems have a number of 1RU trays. Each CloudRack tray can have as many as two server boards that has two CPUs (4 CPUs in 1RU) and 8 disks.

While I wouldn’t necessarily expect that Google would have the highest density of CPUs per rack, it did surprise me to see that they have 1/4 the CPU density of some commercial offerings and 1/8 the disk density! I wonder if this was a deliberate decision to use more server room space to allow slower movement of cooling air and thus save energy.

It’s interesting to note that Google have been awarded patents on some of their technology related to the batteries. Are there no journalists reading the new patents? Surely anyone who saw such patents awarded to Google could have published most of this news before Cnet got it.

Now, I wonder how long it will take for IBM, HP, and Dell to start copying some of these design features. Not that I expect them to start selling their systems by the shipping crate.

Censorship, Piracy, and Movie Ideas

Flame has written a satirical post about the different methods used to try and prevent unauthorised use of copyright movies and the distribution of illegal porn [1]. He has also written an amusing rant about how offended he was by the false advertising of an erotic movie [2].

I think that both these issues need to be addressed at the same time. We need to have an erotic movie about a senator and some movie executives who go on a cruise. It could start with the senator wearing fishnet stockings under his suit while giving a speech about the need to prevent the distribution of pornography and “protect the children“. Then when on the the cruise he meets a young looking woman who likes wearing school uniforms and spends some of his spare time photographing her in artistic poses.

Most of the film would have gratuitous shots of people wearing less clothing than usual and spanking each other (including the senator giving a good impression of Dr Frank n Furter [3]). An element of mystery would also be good – who did the senator sleep with while blindfolded? The finale would have the senator in bed with the movie executives in an analogy of what senators do in real life (except that real life has a lot less spanking).

This plot wouldn’t necessarily imply a movie of Ed Wood [4] caliber. Let’s face it, most Hollywood movies don’t have a plot (the exceptions being those that are copied from successful movies from other times or places).

Disclaimer: This plot idea is strictly a work of fiction and bears no resemblance to any real people (I wouldn’t want my blog to end up in a secretive government blacklist). That said, if you want to imagine that any male politician who gives a speech about “protecting the children” is wearing lingerie while doing so, then go for it (you might even be right).

Inhaling Petrol Fumes

Tonight at 6PM the channel 7 news will have a special report about the dangers of inhaling fumes while filling cars with petrol. I’m blogging now because based on past experience I expect almost no technical content in the report and that the advert for the news show contains everything that is useful.

The advert showed that they had used some film technique to show the fumes leaving the petrol tank while fuel is pumped in. It was obvious that the fumes were rising past the face of the man who was filling the tank. Not that this is really news, if you observe closely when fuel is pumped into a car you can see where the vapor escapes as the slight difference in density causes whatever is behind it to shimmer slightly.

For a long time the Prius has had a bladder inside the fuel tank which expands and contracts to match the fuel volume [1]. This greatly reduces the evaporative loss of fuel when the car is parked and the ambient temperature changes and also when fuel is pumped in. So it seems that in regard to the issue of fuel vapor poisoning the driver, the Prius has been better than other cars for about 10 years. Apparently Toyota have developed a new system that they have implemented in the Hybrid Lexus and the new Hybrid Camry which involves “vapor recovery”, this is supposed to give similar benefits in terms of not releasing petrol fumes into the environment but without limiting the capacity of the fuel tank in cold weather (a common complaint about the Prius). I have not been able to find any technical information on how this works (please let me know if you know a good web page about it).

The next issue is that any car which gives good fuel efficiency and has a reasonable size petrol tank will be better in regard to vapor releases. The less frequently you need to refuel your car the less fuel vapor you will inhale. I predict that channel 7 will not suggest that people drive fuel efficient cars, they are probably more likely to go for hand-wringing about the “inevitable” health problems, or make vague claims that the government should do something about it. The fact that the news show in question is immediately followed by “Today Tonight” (one of the tabloid TV shows) is an indication of the likely quality.

A final issue is the puddles of fuel that you commonly see at petrol stations. People regularly spill reasonable quantities of petrol and Diesel fuel and it just accumulates on the concrete. It’s not uncommon that I will have to drive with my car windows open after buying petrol due to the petrol that I stood in evaporating from my shoes. Apart from training people to not be stupid when refueling their vehicles I can’t think of any way of solving this problem. A petrol station employee once told me that it’s not uncommon for people to refuel cars with their young children standing within splash range of the fuel nozzle. If people can’t manage to avoid splashing their children with fuel then it seems that it will be impossible to get them to do anything reasonable or intelligent regarding the refueling process.

Links March 2009

Cory Doctorow has written a column for The Guardian titled “You shouldn’t have to sell your soul just to download some music” [1]. One really interesting point he made was “The same companies that spent decades telling lawmakers that they were explicitly not the guardians of the morality of the young that they couldn’t be held accountable for sex, drugs and rock’n’roll, for gangsta rap, for drug-fuelled dance-parties did a complete reversal and began to beat their chests about the corrupting influence of downloading on the poor kiddies“.

The pt4me2 organisation advocates that the Victorian government spend more money on public transport infrastructure [2]. Recently the congestion on Melbourne roads has been getting worse, the costs of private car parks in the central city area have been increasing, and during peak hours all public transport is over-crowded. Some significant improvements are needed, and more trains, trams, and buses are the only possible way of coping with the number of people working in the city. Also there’s the issue of suburbs that lack any public transport, I wouldn’t want to live near one of those areas when petrol hits $8/L (as the CSIRO predicts for 2018).

Michael Tiemann writes about Microsoft’s latest patent attack against Linux [3]. He doesn’t pull any punches which is a very noteworthy thing. It’s pretty rare to see someone in a senior position in a company blog in a way that makes any significant comment about another company.

Dan Ariely gave an interesting Ted.com talk about “Our Buggy Moral Code” [4]. One of the points was that people who declare themselves to be atheists are less likely to cheat when asked to swear on a bible first, another was that if someone who is identified as a member of the same group cheats then others will follow, but if an outsider cheats then they won’t. It seems that if you want to minimise cheating then you want to have only outsiders be seen to do it, and you want everyone to swear to follow some sort of moral code.

Flame has written a good rant titled “Anarchy is Dead” about the lack of popular outrage against the Australian government’s censorship plans [5].

Rolling Stone magazine has a good article about the US banking crisis [6]. A moderate amount of bad language, but no more than is deserved.

Amazing video of rounding up sheep that are fitted with LEDs at night [7].

Here’s an interesting TED talk by Saul Griffith about using kites to generate electricity [8]. Unfortunately he didn’t give much engineering information, it was more of an “executive summary” of what he has done. He claims that if a wartime level of effort was put in place then wind could supply all the electricity needs of the US within 10 years.

Adam Savage (of Mythbusters fame) gave a talk for TED about his obsession with the Dodo [9]. One thing that surprised me is how his manner in that talk differed from his appearance in Mythbusters. It seems that most of his crazy antics in Mythbusters are an act to entertain the audience. The information about the dodo was really interesting too. He then went on to talk about his recreation of the Maltese Falcon. His work can serve as inspiration for other geeks who want to try sculpting.