Linux Today: Linux News On Internet Time.
Search Linux Today
search.internet.com
Linux News Sections:  Blog -  Developer -  High Performance -  Infrastructure -  IT Management -  Security -  Storage -
Linux Today Navigation
LT Home
Preferences
Contribute
Link to Us
Search
Linux Jobs

internet.commerce
Be a Commerce Partner

Best Price
KVM Switches
Computer Deals
Logo Design
Online Shopping
Auto Insurance Quote
Online Education
Car Donations
Free Business Cards
Dental Insurance
Disney World Tickets
Find Software
Phone Cards
Promote Your Website

The Linux Channel at internet.com
Linux Today
Enterprise Linux Today
Apache Today
JustLinux.com
Linux Planet
PHPBuilder
All Linux Devices
Technology Jobs

 
Webcast: Hacking 101--The Top 10 Attacks in Web Applications
Defend your web applications from attack. Learn about the three most common web application attacks, including how they occur and what can be done to prevent them. Well also discuss manual versus automated approaches for scanning and identifying web application vulnerabilities and how IBM Rational AppScan, an automated vulnerability scanner, can help you automate more of what you are doing manually today. View the webcast;
Featured on the DevX Skillbuilding for IBM Developerworks

Featured Solutions for Technology Professionals from Internet.com
Relieve the Training Bottleneck with Rapid E-Learning
Sponsored by Adobe
As product life-cycles decrease and speed-to-market pressures increase, the ability to train workers efficiently becomes paramount to a company's ability to compete. Rapid e-learning can make a significant contribution to your training efforts in your organization. Download this whitepaper to learn more.


Current Newswire:

Ubuntu Netbooks vs. Ubuntu Mobile Internet Devices: What's the Difference?

Confirmed: Canonical Ubuntu Server Blitz at LinuxWorld Expo

OS Roundup: BSD Bug Emerges From Chrysalises

Simple Multiple-Steam Output Redirection With Zsh On Linux and Unix

Setting up DRBD in an Open Source SAN

SECURITY: Attack Code Published for DNS Flaw

SCO Group: Its Future is All Used Up

Researcher Spills Beans on DNS Flaw Specs

CLI Magic: For Geek Cred, Try These One-liners

Return of the InstallFest...It Starts Here

Sr. Unix Adminsitrator with Secret Clearance
The Computer Merchant, Ltd
US-VA-Springfield

Justtechjobs.com Post A Job | Post A Resume
:At last, a Mindcraft 'Open Benchmark'
At last, a Mindcraft 'Open Benchmark'
May 4, 1999, 23 :53 UTC (33 Talkback[s]) (8205 reads)

(Other stories by Dwight Johnson)

by Dwight Johnson

In response to criticism of its Linux versus Windows NT benchmark comparisons commissioned by Microsoft, Mindcraft is withholding the publication of its second Linux and Windows NT Server benchmark results pending an Open Benchmark Invitation.

Mindcraft believes that the best way to continue to show our name as a credible source of information is to have an Open Benchmark. Therefore, we welcome the opportunity to perform a benchmark of Linux and Windows NT Server that is open to the best experts in the Linux community. Mindcraft will participate in this benchmark at its own expense.

Linux Today applauds this invitation by Mindcraft. Free Software and Linux stand much more to gain than they could ever lose in a truly fair and objective comparison between Linux and Windows NT. In fact, it is quite likely that any deficiencies in the software would be quickly addressed by a swarm of Free Software developers.

But Samba development team member, Jeremy Allison, takes issue with one benchmark requirement stipulated by Mindcraft, in particular that:

... the tests will use Windows 9x clients (these can be in any mix including all clients using the same Windows 9x OS). The same client set up will be used for both Linux and Windows NT Server.

In a letter to Mindcraft's Bruce Weiner, Jeremy stipulates some requirements of his own:

In order to participate, I must insist that Windows NT clients are *also* benchmarked.

I feel that it is very much in the interest of consumers to be able to choose between clients, and surely Microsoft would be interested in publishing the results of their flagship workstation operating system, running against their flagship server, using their flagship filesystem.

I insist that we also have NT clients running against NT server and Samba servers, using an NTFS filesystem on NT, and an equivalent secure filesystem (ext2fs) on Linux added to the mix.

There are no problems running Win9x clients against NT using whatever file system you wish as well, but not also showing the NT client data is *extremely* disingenuous, as I'm sure you already know.

Your original benchmark was funded by, and on behalf of Microsoft, run in their labs (as you have now revealed). This new benchmark is different and is a joint effort between Microsoft and the Open Source community to publish meaningful numbers to allow consumer choice. In order to be able to use our names on this we must have some input into the benchmarking specifications.

If you refuse to consider this important addition to the matrix I will have no option but to publicly refuse to participate and publish our own Win9x client to NT or Samba server, and WinNT client to NT or Samba server benchmark matrix, and let our own credibility be assessed by the public.

Linux Today endorses the view of Jeremy Allison that a truly 'Open' benchmark must allow both sides an equal opportunity to stipulate testing conditions -- particularly in this case where the Allison proposal does not restrict the Mindcraft benchmark platform in any way but merely adds an additional platform against which to test.

The Jeremy Allison proposal should, in fairness to truth, be accepted and then... let the benchmark proceed!


Index Mode   |   Flat Mode   |   Thread Mode   |   Thread Flat  
  Talkback(s) Name  and Date
... if NT does not just crash in the mid ...   Microsoft should be happy...   
Dani
May 4, 1999, 22:51:58
 
MindCraft is on the ropes.  Their credib ...   MindCraft has to agree   
Todd Lewis
May 4, 1999, 23:42:14
 
Well said!

Jim ...   Damn that was good   
Jim O'Quinn
May 5, 1999, 00:04:55
 
By agreeing that the first benchmark nee ...   Linux has already won   
Felix Finch
May 5, 1999, 00:36:42
 
Yes, this is a very obvious requirement. ...   Necessary requirement   
Ricky Ng-Adam
May 5, 1999, 00:46:06
 
... this is way too exciting! :-) ...   Can't breathe...   
Dev Null
May 5, 1999, 01:11:19
 
Is Samba crap at serving win95 clients o ...   Why insist on NT   
Tarcus
May 5, 1999, 02:10:22
 
If this were in the real world somebody  ...   Where's the budget?   
Paul Ashton
May 5, 1999, 02:46:28
 
Here is a test.  Nobody will go for it b ...   CD-Rom it   
Kevin Sproul
May 5, 1999, 03:21:08
 
Neither are "crap".  There is a performa ...   Re: Why insist on NT   
John McNulty
May 5, 1999, 04:57:07
 
M$ won't associate itself with confr ...   It's a trap.   
Tim Hanson
May 5, 1999, 05:00:24
 
Sorry but you missed the point.  it is m ...   Re: Why insist on NT   
Paul Lai
May 5, 1999, 05:18:58
 
We are all dancing to MS/MC's tune,  ...   still sounds like a trap!   
Aaron Trevena
May 5, 1999, 05:40:30
 
Didn't I read an article a few weeks ...   NT in the test.   
Dave Thurston
May 5, 1999, 05:51:49
 
Since they seem to be billing this as a  ...   Apache isn't fast   
Cadaver
May 5, 1999, 06:10:40
 
Get Linus, Alan Cox, who ever it takes d ...   Go for it!   
Kenneth Scharf
May 5, 1999, 07:45:36
 
Yes, Jeremy has stated that NT is faster ...   Makes sense. was: Re: Why insist on NT   
David L. Parsley
May 5, 1999, 07:45:48
 
I personally would love to know how they ...   How about 95, NT and LINUX clients?   
Tim Kelley
May 5, 1999, 08:25:34
 
Jeremy is only insisting on benchmarking ...   Re: Why insist on NT   
Michael J. Ball
May 5, 1999, 09:57:49
 
The probably cannot afford the client li ...   Why Mindcraft wants W9x clients   
Ralph
May 5, 1999, 10:20:20
 
The probably cannot afford the client li ...   Why Mindcraft wants W9x clients   
Ralph
May 5, 1999, 10:20:42
 
There needs to be a couple of more stipu ...   Re: MindCraft has to agree   
Svartalf
May 5, 1999, 10:28:53
 
That has to be, I'd say, the most br ...   Re: CD-Rom it   
Svartalf
May 5, 1999, 10:31:44
 
Why not each major Linux vendor get the  ...   Vendors participate   
james
May 5, 1999, 16:35:18
 
I agree, this would be the most brutal t ...   CD-Rom it   
Dennis Benedict
May 5, 1999, 17:39:54
 
Sounds like a cry for best two out of th ...   Why was round two kept under wraps?   
David B. Jackson
May 6, 1999, 20:53:55
 
All other "benchmarks" that Mindcrafty h ...   Price/Performance Numbers   
Paul Stroud
May 7, 1999, 06:18:46
 
What exactly are we testing here?  

Lin ...   too many peices   
Jim
May 9, 1999, 05:51:31
 
Whatever the outcome may be, I guess the ...   Better have two tests   
Ard van Breemen
May 13, 1999, 02:23:18
 
Also, one should consider the quality of ...   Net. Card drivers   
J. Bulyk
May 16, 1999, 18:51:12
 
"Likewise every good tree bears good fru ...   Shake the tree   
Rodney Quaye
May 17, 1999, 08:12:27
 
Whoa. That was some speech. ...   Bravo!   
B. Lalli
Jul 13, 1999, 05:51:23
 
Why don't we load balance with a beo ...   Lets use a cheaper system and make a beowulf.   
Matthew Coulson
Sep 7, 1999, 17:30:44
 
  Home | Search Talkbacks | Customize View    Top of Page  



Enter your comments below:

* Your Name:

* Your Email Address:

* Subject:

CC: [will also send this talkback to an E-Mail address]

* Comments:

Tags allowed:<I>,<B> and <U>. See our talkback-policy for more about talkback content.

Fields marked with * are required!


VMware Whitepaper: From Fixed To Fluid--Enabling the Data Center Metamorphosis
Intel Whitepaper: Comparing Multi-Core Processors for Server Virtualization
Gartner Whitepaper: US Data Centers--The Calm Before the Storm
14-Day Qualys Trial: Find Out in Minutes if Your Network is Vulnerable!
eKit: Web 2.0 Developer

..............................


All times are recorded in UTC.
Linux is a trademark of Linus Torvalds.
Powered by Linux, Apache and PHP

JupiterOnlineMedia

internet.comearthweb.comDevx.commediabistro.comGraphics.com

Search:

Jupitermedia Corporation has two divisions: Jupiterimages and JupiterOnlineMedia

Jupitermedia Corporate Info


Legal Notices, Licensing, Reprints, & Permissions, Privacy Policy.

Advertise | Newsletters | Tech Jobs | Shopping | E-mail Offers