The Mozilla
Organization
At A Glance
Feedback
Get Involved
Newsgroups
License Terms
Newsbot
Developer Docs
Roadmap
Projects
Ports
Module Owners
Hacking
Get the Source
Build It
Testing
Download
Bugzilla
Bug Writing
Tools
View Source
Tree Status
New Checkins
Submit A Bug
FAQ
Search
Mail Performance Results - Mac

Post feedback to: netscape.public.mozilla.mail-news


General:
Introduction
Test Machine Configuration
Notes
Results:
Startup
POP
IMAP
News
Address Book
Message Compose


Introduction
We are evaluating and testing the performance of various mail tasks. At this time, we are using Communicator 4.7 as a reference to compare the results. Bugs will be filed and tracked for tasks where the performance is not acceptable or slower than 4.7. The builds used are the Netscape commercial builds and the dates of the builds are listed in parenthesis in the results table. We hope to execute these tests on a regular basis as well as add additional mail tasks that can be measured. Improving performance is a continual process and we will be adding more as time goes on!

Test Machine Configurations:

  • Mac:
  • Mac PPC 8.5.1, 150 Mhz.
  • 64 MB RAM
  • LAN
  • Last Build tested on 1/27/00.
  • Linux: (Click  here for latest results)
  • Pentium 133 Mhz.
  • 64 MB RAM.
  • Red Hat 6.0
  • LAN
  • Last Build Tested on 2/16/00.
  • Windows:  (Click  here  for latest results)
    • Pentium 133 Mhz
    • 64 MB RAM and 32MB RAM*
    • Windows 95
    • LAN
    • Last Build tested on 02/23/00.
    *After initial tests were done with 32MB RAM, we increased the memory to 64MB RAM; nothing else on the test machine was changed.
    Notes:
    • All the time measurements are in seconds.
    • Currently, tests are done manually with a stop watch. Error rate: +/- 1 seconds.
    • Legend:
      • NI - not implemented in the build being tested
      • NT - not testable in the build being tested.
      • SD - Standard Deviation of 5 Test runs.
    Results:
    No. Feature/Task Test 4.7 Performance
    (64 MB RAM)
    Seamonkey Performance
    (1/27/00)
    (64 MB RAM)
    Mean
    SD
    MailStartup
    1 Mail Startup after Navigator  Launch Navigator and then open Mail 3.30
     15.656
     0.247
    2 Mail Startup First Launch Mail (no other Seamonkey Components are loaded)
     6.47
     21.378
     0.378
    3 Maximize the Mail Window After starting Mail, maximize the Mail window
     0.89
     1.624
     0.272
    POP Mail
    1 POP: Mail Download Download 500 messages (no summary file)
     10.89
     22.762
     0.670
    2 POP: Summary File Creation Create summary file for 1,000 message Inbox (summary file does not yet exist)
     20.68
     34.490
     0.720
    3 POP: Load Summary File Load summary file for 1,000 message Inbox (summary file exists)
     2.58
     6.922
     0.172
    4 POP: Sort Folder Select a folder with 1,000 messages; sort by subject, then reverse the sort order of subject
     4.75
     11.240
     0.209
    5 POP: Display 5 Messages without Attachment Display 5 10-Kb messages that contain HTML formatting
     8.76
     25.544
     0.315
    6 POP: Display 2 Messages with Attachments Display 2 10-Kb message that each have 100 Kb attachments
     10.15
    62.320
    0.915
    7 POP: File 5 Messages File 5 10-Kb messages from the POP Inbox to a local folder
     2.06
     5.464
     0.107
    8 POP: Delete 5 Messages Delete 5 10-Kb messages from the POP Inbox
     9.92
     33.520
     0.388
    9 POP: Create New Folder Create a new POP folder
     2.97
     3.218
     0.095
    10 POP: Undo Delete Message In a POP account, select and delete a message, then undo the delete
     1.16
     1.944
     0.045
    11
    POP: Scroll Bar In a POP account, select a folder with 500 messages, Scroll to the bottom of Thread Pane
     1.24
     2.176
     0.090
    IMAP Mail
    1 IMAP: Header Download Download 1,000 email headers (no summary file)
     28.71
     45.494
     0.484
    2 IMAP: Update IMAP Summary File Download an additional 50 headers to an IMAP Inbox that already contains 1,000 headers (summary file exists)
    5.17
     45.920
     0.593
    3
    IMAP: Load Summary File Load summary file for 1,000 message Inbox (summary file exists)
     2.48
     12.326
    0.164 
    4 IMAP: Display 5 Messages without Attachment Display 5 10-Kb messages that contain HTML formatting
     9.06
     23.266
    0.242 
    5 IMAP: Download and Display 2 Messages with Attachments Download and display 2 10-Kb message that each have 100 Kb attachments
     11.91
    98.592
    4.706
    6 IMAP: File 5 Messages File 5 10-Kb messages from the IMAP Inbox to an IMAP folder
     2.09
     4.202
    0.131 
    7 IMAP: Delete 5 Messages Delete 5 10-Kb messages from the IMAP Inbox
     10.89
     27.256
    0.212 
    8 IMAP: Move Messages to Local Folder Move 100 10-Kb Messages from IMAP server to local folder
     15.93
     75.316
    2.088 
    9 IMAP: Create New IMAP Folder Create a new IMAP folder
     1.68
     4.244
    0.098 
    10 IMAP: Expand Folder List Select an IMAP account and expand the folder list for that account; the folder list should contain at least 20 folders
     1.10
     0.972
    0.047 
    News
    1 NNTP: Header Download Download 1,000 news headers from NNTP Server (no summary file)
     8.76
     23.762
    0.336 
    2 NNTP: Update Summary File Download an additional 50 headers to a newsgroup that already contains 1,000 headers (summary file exists) .
    NT
    .
    3 NNTP: Load Summary File. Load summary file for 1,000 message newsgroup (summary file exists)
     3.17
     11.474
    0.268 
    4 NNTP: Display 5 Messages Display 5 5-Kb messages (plain text)
     7.12
     28.796
    0.359 
    5 NNTP: Delete Message Delete a news message that you have posted
     1.59
     4.798
    0.099 
    6 NNTP: Mark All Read Mark ~500 News Messages as read
     2.32
     23.842
    0.206 
    Address Book
    There is no 'Status Bar' in Address Book. We couldn't test "Open a local address book that contains 200 address book cards" and others at this time.
    1 Open Local Address Book Open a local address book that contains 200 address book cards . . .
    2 View 5 Address Book Cards View 5 address book cards (out of a total of 200 cards in the address book) . . .
    3 Open "Edit Card" Dialogue Open the Edit Card Dialogue by double clicking on an address book entry
     0.65
     6.106
    0.128 
    MessageCompose
    1 Open Compose Window Open the Compose Window
     1.12
     10.786
    0.172 
    2 Auto-complete Auto-complete 5 email addresses against a 200 card local address book . . .
    3 Address Message to 10 Recipients Address an email message to 10 recipients: type in first email address, press return, type in second email address, ... . . .
    4 Add 2 Attachments Add 2 100-Kb attachments to a message
     4.24
     9.544
    0.168 
    5 Compose HTML Message After addressing message and entering subject line, tab into message body and:
    • Bold some text 
    • Insert a link 
    • Insert a GIF image 
    • Add a bulleted list 
    • Indent a paragraph 
    • Center a paragraph 
    • Select and delete some text
    Note: must use exactly the same text, images and formatting across tests
     1.25
    bug 25259
    6 Send Message (No Attachment) Send a 10 Kb HTML formatted email message
     1.38
    bug 25259
    7 Send Message With Attachment Send a 10 Kb HTML formatted email message with a 100 Kb attachment
     4.02
    bug 25259



    Table initially created by Sol Goldfarb
    Timings updated by Suresh Kasinathan
    Copyright © 1998-2000 The Mozilla Organization.
    Last modified February 24, 2000.