Wikiposts
Search
Computer/Internet Issues & Troubleshooting Anyone with questions about the terribly complex world of computers or the internet should try here. NOT FOR REPORTING ISSUES WITH PPRuNe FORUMS! Please use the subforum "PPRuNe Problems or Queries."

NTFS or FAT32?

Thread Tools
 
Search this Thread
 
Old 9th Jul 2006, 10:51
  #1 (permalink)  
Thread Starter
 
Join Date: Jul 2000
Location: UK
Posts: 1,528
Likes: 0
Received 3 Likes on 3 Posts
NTFS or FAT32?

Having only recently bought a new dual core acer laptop I was surprised to see the hard disc is FAT32 rather than NTFS. Why would this be and are there any advantages to using NTFS (which I did on the previous one)
Background Noise is offline  
Old 9th Jul 2006, 11:28
  #2 (permalink)  
Spoon PPRuNerist & Mad Inistrator
 
Join Date: Sep 2003
Location: Twickenham, home of rugby
Posts: 7,398
Received 265 Likes on 173 Posts
Errrr...

None. Have a look at this.

As to why? Probably easier for the manufacturer to install.

SD
Saab Dastard is offline  
Old 9th Jul 2006, 17:57
  #3 (permalink)  
 
Join Date: Jun 2003
Location: EuroGA.org
Posts: 13,787
Likes: 0
Received 0 Likes on 0 Posts
A couple of years ago I did a lot of benchmarking between FAT16, FAT32 and NTFS, using a special program which allowed the filesize to be adjusted, etc.

NTFS was *much* slower when accessing lots of small files, say 1k in size. So slow in fact that it was not possible to write them to a 32x CD writer, without creating an intermediate image. This was a top-spec 10,000rpm SCSI hard disk fed off a £300 Adaptec SCSI controller, using the fastest available SCSI interface.

I now install FAT32 every time.

The main advantages of NTFS over FAT32 are

File size not limited to 4GB

Much better security; can have much finer granularity on permissions (irrelevant to most private users)

But for speed, FAT32 is probably better. I recently set up a special PC (3GHz, 1GB RAM, 100GB 10,000rpm SATA HD, top-end video card) mainly to run Pinnacle 10 for transferring HD data (over 1394) from a Sony HD HC1 cam, and it works better when writing the stuff to a FAT32 partition than an NTFS one.

BTW I am not happy about that other thread getting locked, especially as nobody actually answered my question.
IO540 is offline  
Old 10th Jul 2006, 08:27
  #4 (permalink)  
 
Join Date: Jun 2006
Location: Italy
Age: 42
Posts: 31
Likes: 0
Received 0 Likes on 0 Posts
fat 32 wastes a lot of space on the hard disk just to memorize the File Allocation Table at the beginning of the hard disk after the MBR. it's a bit complicated to say how a fat works here but it isn't a very good file system..let's say, it's not very efficient as NTFS or as the linux file systems are.. if anybody studied operating systems or C language, they'll understand me..this is a fat: it's a table made of two columns, on the first there are all the blocks of the hard disk, on the second, there are pointers or blocks to which the first blocks are linked..let's say a file is allocated in 3 blocks on the hard disk, 10, 11, 12.. in the fat beside the 10 there will be 11, beside 11 a 12, beside 12 an EOF(end of file).. when u open that file, it'll start reading block 10, since it points to block 11, it'll then read block 11 and this points to 12 so it'll read 12 and then it'll see EOF so it stops. this table takes a lot of unnecessary space.
fabrifx is offline  
Old 10th Jul 2006, 11:03
  #5 (permalink)  

Plastic PPRuNer
 
Join Date: Sep 2000
Location: Cape Town
Posts: 1,898
Received 0 Likes on 0 Posts
NTFS is not much slower that FAT32 on drives with a built-in cache (almost all these days) and far more efficient. Furthermore it's a journalled file system (like ext3 or Reiser FS) so is much more robust in the face of damage. FAT32 has effectively no security, while NTFS has excellent, fine-grained security. On todays big drives FAT32 is an inefficient anachronism.

Thanks to MS, the structure of NTFS is is a closed proprietary secret, so other operating systems have trouble accessing NTFS drives. Linux and other OSes can read NTFS alright, but writing is more problematic. Various schemes exist to allow other OSes to read/write NTFS - some of them use a wrapper for the MS drivers themselves and are pretty reliable, but this is not sanctioned by MS, though if you have Windows installed on another partition it's probably legal.

The only time I'd use FAT32 nowadays would for for a local partition that I needed to access regularly from Linux and Windows. Even then, I'd probably use ext3 and use ext2fsd (an installable file system driver for Windows) to allow me to access the ext3 partition from Windows rather than vice-versa.

NTFS is an excellent filesystem, it's just a pity that MS are so bent on preventing interoperability with other systems that they won't even release a binary driver, let alone publish the specifications.

NB:
It's exactly the same problem with the MS SMB/CIFS network system - MS doesn't want other systems to be able to access Windows systems over a network. MS wants you to chuck your other system and buy Microsoft, so they keep the structure of SMB/CIFS a closely guarded secret.

Happily Andrew Tridgell analysed SMB/CIFS (an enormous task) and wrote the open SAMBA protocol which allows other systems to interface with MS's SMB/CIFS. This works perfectly and the SAMBA team probably now know more about SMB/CIFS than Microsoft!

PS: There is an alternative to SAMBA and SMB/CIFS. Linux/UNIX supports NFS (Network File System) natively and if you install Microsoft's Services for Unix, Windows can too. I found it much harder to set up than SAMBA and never really got it going satisfactorily (if I'd RTFM I'd probably have been more successful!).
Mac the Knife is offline  
Old 10th Jul 2006, 20:06
  #6 (permalink)  
PersonalTitle to help support PPRuNe against legal bullying.
 
Join Date: Sep 2005
Location: France
Posts: 134
Likes: 0
Received 0 Likes on 0 Posts
All jolly interesting to read, I am not sure we answered one of the questions posted...

Your laptop will almost certainly be I/O limited when it appears so slow down - that is you will be normally be waiting for disk reads/writes to occur (regardless of how much memory you have). Exactly how that I/O wait is triggered depends on what you are doing (which applications you run and what you do with them). That is almost impossible to predict on a laptop as the use would be so varied, and is impacted by the applications, their configuration, the size of RAM and size of paging files etc etc.

Why would you want the fine grained security of NTFS if you bought a home computer - had you purchased a laptop for business/corporate/office use they might have considered that you would connect it to a MS domain and hence want to make use of those security features when sharing data.

Most likely FAT32 was the easiest and most flexible filesystem image to dump on the disk for the vendor, and given that the sales channel you used was targetted at home use, as opposed to business/corporate network use, this is most likely the explanation as to why you found FAT32.

Unless you can describe an accurate set of use scenarios that represent how you are going to use your laptop (almost impossible to do) and then run parallel tests, one on NTFS and the other on FAT32, then you will have no idea which will actually perform best. But you asked why FAT32 (not just which was better) and the answer is almost certainly that it was easier for the vendor

I agree with the above that NTFS is always a better choice just for reliability. Can anyone remember the NT "convert" command to change the filesystem to NTFS? It's been 8 years since I used it....

Last edited by tallsandwich; 10th Jul 2006 at 20:20.
tallsandwich is offline  
Old 10th Jul 2006, 21:02
  #7 (permalink)  
 
Join Date: Jun 2003
Location: EuroGA.org
Posts: 13,787
Likes: 0
Received 0 Likes on 0 Posts
All very good tech points for NTFS, but not really relevant to a single user scenario with unlimited physical access by that user, and (one assumes) zero physical access for everybody else.

1. Caching is of no help with lots of small files being read for the first time in ages (hence my CD writing example)

2. NTFS security is exactly zero unless you have rock solid physical (access) security. If somebody can stick a DOS6.2 boot disk (or a suitable boot CD) in, with NTFSDOS on it, you can forget all security... So, no relevance to personal users. Equally, if an attacker can execute code of his choice (the case with most of M$ "buffer overflow" back doors) security is back to zero.

3. Efficiency doesn't come into it, with today's massive hard drives.

4. I wouldn't agree that NTFS is better for reliability, in the data recovery sense. I think NTFS does support full journalling but doesn't actually implement it (it would be impractical). So the data is stored only once and if you lose that bit you have lost it - just like FAT16, FAT32, etc. The worse thing, with a crashed drive, is that with FAT you can retrieve anything undamaged on the HD easily whereas NTFS is a right jumble.
IO540 is offline  
Old 10th Jul 2006, 22:29
  #8 (permalink)  
Spoon PPRuNerist & Mad Inistrator
 
Join Date: Sep 2003
Location: Twickenham, home of rugby
Posts: 7,398
Received 265 Likes on 173 Posts
tallsandwich, I think I did answer the "why it was installed" question in my first response, although without explaing why it would be easier.

The link I posted also had a comparative performance test between FAT32 and NTFS - OK, sponsored By MS - that indicated that there was less than 2% performance difference.

I can think of several reasons why NTFS on a home PC is desirable, if not essential!

To my mind, the most compelling reason to use NTFS on a home PC is to prevent malware from accessing the system files when connected to the internet.

With NTFS and logged on as a USER, rather than Admin, it is extremely unlikely that any system files can be modified. Not totally waterproof (mixing metaphors, here I think), but every little helps.

There is simply no equivalent protection with FATxx.

The second important reason for a home PC to run NTFS is for multiple users in a family to have private areas (agreed, accessible to admin equivalent, and susceptible to physical attack with various "hacking" tools).

It is also very important to have children's access restricted to USERS so that they cannot (again, caveats apply) inadvertently break the OS.

There is nothing with FAT32 to prevent system files being deleted. Please correct me if I'm wrong - I have never run an NT system since 3.51 without NTFS, and the last time I used FAT32 was with Win98!

Fair enough, if you are the only person in the household, then only the first reason is important - and if you connect to the internet as administrator then not even that. But I believe that it is less secure.

SD
Saab Dastard is offline  
Old 11th Jul 2006, 07:38
  #9 (permalink)  
PersonalTitle to help support PPRuNe against legal bullying.
 
Join Date: Sep 2005
Location: France
Posts: 134
Likes: 0
Received 0 Likes on 0 Posts
Good points, Sad Bastard
tallsandwich is offline  
Old 11th Jul 2006, 09:04
  #10 (permalink)  

Plastic PPRuNer
 
Join Date: Sep 2000
Location: Cape Town
Posts: 1,898
Received 0 Likes on 0 Posts
Hre ye go tallsandwich

Convert
Converts FAT and FAT32 volumes to NTFS

Syntax:
convert [volume] /fs:ntfs [/v] [/cvtarea:FileName] [/nosecurity] [/x]

Parameters
volume Specifies the drive letter (followed by a colon), mount point, or volume name to convert to NTFS. /fs:ntfs Required. Converts the volume to NTFS. /v Specifies verbose mode, that is, all messages will be displayed during conversion. /cvtarea:FileName For advanced users only. Specifies that the Master File Table (MFT) and other NTFS metadata files are written to an existing, contiguous placeholder file. This file must be in the root directory of the file system to be converted. Use of the /CVTAREA parameter can result in a less fragmented file system after conversion. For best results, the size of this file should be 1 KB multiplied by the number of files and directories in the file system, however, the convert utility accepts files of any size.

Important
•You must create the placeholder file using the fsutil file createnew command prior to running convert. Convert does not create this file for you. Convert overwrites this file with NTFS metadata. After conversion, any unused space in this file is freed. For more information about the fsutil file command, see Related Topics.

/nosecurity Specifies that the converted files and directory security settings are accessible by everyone. /x Dismounts the volume, if necessary, before it is converted. Any open handles to the volume will no longer be valid.

Remarks
•You must specify that the drive should be converted when the computer is restarted. Otherwise, you cannot convert the current drive.
•If convert cannot lock the drive (for example, the system volume or the current drive), it offers to convert the drive the next time the computer restarts.
•The location of the MFT is different on volumes that have been converted from previous version of NTFS, so volume performance might not be as good on volumes converted from Windows NT.
•Volumes converted from FAT to NTFS lack some performance benefits compared to volumes initially formatted with NTFS. On converted volumes, the MFT might become fragmented. In addition, on converted boot volumes, NTFS permissions are not applied after the volume is converted.

PS: NTFS is always journalled. You can remove some of its overhead by disabling its last file access update (which it does even when you so much as look at the contents of a directory). Go into Regedit and go to HKLM/System/CurrentControlSet/Control/FileSystem. Create a REG_DWORD called NtfsDisableLastAccessUpdate and set it to 1.

But I can't see any real point in doing this!
Mac the Knife is offline  
Old 11th Jul 2006, 09:42
  #11 (permalink)  
PersonalTitle to help support PPRuNe against legal bullying.
 
Join Date: Sep 2005
Location: France
Posts: 134
Likes: 0
Received 0 Likes on 0 Posts
NTFS is always journalled
But it seems IO540 thinks that althought it is journalled it is not 'implemented'. I always thought that the recovery features of NTFS were better (i.e. it could recover it's state more quickly and more accurately than FAT when a file system integrity check was required).

Journalling is just one of many ways to help acheive this recvoery process, right? There are many non journalled filesystems that have reasonably good recvoery mechanisms (for example good old UFS).

IO540, do you have any more info? I've seen many NTFS volumes recover from an inconsistient state (and recover wihout data loss) but I've never (to my knowledge) seen a FAT32 filesystem go successfully through this process.

If FAT32 is really just as good at recovering from inconsistent state as NTFS then I would certainly like to know. At the end of the day, on a single spindle system like most laptops, data reliability is almost certainly higher on the prioirty list for most people than marginal performance imporvements. Just to avoid confusion I am not talking about taking that failed volume and putting it in another device to facilitate recovery, I am talking about the self recovery of that single spindle machine without using specialist tools - that is the scenario that matters for 99% of laptop users.

Cheers.
tallsandwich is offline  
Old 11th Jul 2006, 11:17
  #12 (permalink)  

Plastic PPRuNer
 
Join Date: Sep 2000
Location: Cape Town
Posts: 1,898
Received 0 Likes on 0 Posts
NTFS is proprietary, so info about that goes on inside can only be deduced from "black box" techniques.

From - http://www.usenix.org/events/usenix0...html/main.html

"Although the source code or documentation of NTFS is not publicly available, tools for finding the NTFS file layout exist [28].

We ran the Windows XP operating system on top of VMware on a Linux machine. The pseudo device driver was exported as a SCSI disk to the Windows and a NTFS file system was constructed on top of the pseudo device. We ran simple workloads on NTFS and observed traffic within the SBA driver for our analysis.

Every object in NTFS is a file. Even metadata is stored in terms of files. The journal itself is a file and is located almost at the center of the file system. We used the ntfsprogs tools to discover journal file boundaries. Using the journal boundaries we were able to distinguish journal traffic from fixed-location traffic.

From our analysis, we found that NTFS does not do data journaling. This can be easily verified by the amount of data traffic observed by the SBA driver. We also found that NTFS, similar to JFS, does not do block-level journaling. It journals metadata in terms of records. We verified that whole blocks are not journaled in NTFS by matching the contents of the fixed-location traffic to the contents of the journal traffic.

We also inferred that NTFS performs ordered journaling. On data writes, NTFS waits until the data block writes to the fixed-location complete before writing the metadata blocks to the journal. We confirmed this ordering by using the SBA driver to delay the data block writes upto 10 seconds and found that the following metadata writes to the journal are delayed by the corresponding amount."

So NTFS is not a fully journalled file system (and there are different iinterpretations and implementations of "full") - so what? FAT32 has essentially no protection against file corruption and only a second FAT to "protect" against volume corruption (which is doesn't). FAT32 cannot recover from an inconsistent state - chkdsk which just discards anything that doesn't fit the primary FAT (which may itself be corrupt). NTFS can and does recover from inconsistent states, and remarkably well at that.

Roughly, the different kinds of journaling are:

1) data=writeback -- does no journalling of data; metadata only. fastest. data corruption possible in system crash.

2) data=ordered -- strictly speaking only journals metadata but uses transactions to protect data as well. slightly slower than writeback mode. Because of the way the blocks to be written to disk are ordered in this mode, it offers all the protection of full data journalling mode when files are being appended to; corruption is possible when files are being overwritten.

3) data=journal -- full journalling of data and metadata. Should be slowest because data is written twice, once to journal & once to final location. However some tests have shown that its performance surpasses the other two modes in busy interactive environments where disks are being read from & written to at same time. Also requires the largest disk footprint for journal.

So NTFS uses something on the data=ordered model - and so?

"I wouldn't agree that NTFS is better for reliability, in the data recovery sense."

Oh please.....

Finally, "..NTFS security is exactly zero unless you have rock solid physical (access) security..."

With physical access to ANY machine breaking in is trivial. Once in, it may even be possible to recover encryption keys and read 128-bit encrypted files (brute force won't do it). Without physical access to the machine(and assuming not-rooted), correctly set up NTFS permissions make seeing things you ain't meant to exceedingly difficult.

Don't blame NTFS (which is a nicely balanced filesystem) when the poor security model of the overlying OS is the real problem.

I'm not actually sure what you're complaining about to be honest.
Mac the Knife is offline  
Old 11th Jul 2006, 12:20
  #13 (permalink)  
Spoon PPRuNerist & Mad Inistrator
 
Join Date: Sep 2003
Location: Twickenham, home of rugby
Posts: 7,398
Received 265 Likes on 173 Posts
Further NTFS advantages - even for the single user scenario - are file compression, volume mount points, directory junctions, hard links and symbolic links. There is also support for volume shadowing and sparse files.

There's more, but it begins to become somewhat esoteric!

SD
Saab Dastard is offline  
Old 11th Jul 2006, 12:41
  #14 (permalink)  
PersonalTitle to help support PPRuNe against legal bullying.
 
Join Date: Sep 2005
Location: France
Posts: 134
Likes: 0
Received 0 Likes on 0 Posts
So it would appear that unless Background Noise's laptop was being used for very specific high I/O requirements (where FAT32 has been shown by IO540 to outperform NTFS) then the filesystem on said laptop would be better being converted to NTFS. What do you think, Background Noise? Ready to convert?
tallsandwich is offline  
Old 12th Jul 2006, 20:50
  #15 (permalink)  
Thread Starter
 
Join Date: Jul 2000
Location: UK
Posts: 1,528
Likes: 0
Received 3 Likes on 3 Posts
Well I'm not sure about converting - I need to re-read the stuff above and/or research. I guess I was just surprised having thought that NTFS was the newer, and therefore better() system. I used it previously on my home laptop which I formatted and loaded from scratch. This one came preinstalled and I only discovered the format by right clicking the pre-partitioned drives. I might wipe he whole thing sometime though as I get hacked off with most of the supplied stuff - when I can work out how to keep/re-install the utilities I want from acer.
Background Noise is offline  
Old 13th Jul 2006, 04:52
  #16 (permalink)  
Psychophysiological entity
 
Join Date: Jun 2001
Location: Tweet Rob_Benham Famous author. Well, slightly famous.
Age: 84
Posts: 3,270
Received 37 Likes on 18 Posts
Most of the discussion seems to have revolved around well managed discs. What of the long-term neglected disc, and the issue of fragmentation?
Loose rivets is offline  
Old 13th Jul 2006, 07:18
  #17 (permalink)  

Plastic PPRuNer
 
Join Date: Sep 2000
Location: Cape Town
Posts: 1,898
Received 0 Likes on 0 Posts
Originally Posted by Background Noise
I guess I was just surprised having thought that NTFS was the newer, and therefore better() system.
Newer isn't always better, but I sort of thought we'd established in this discussion that NTFS was, for all except quite special situations, a great deal better than the old FAT32 filesystem.

I think IO540 is completely wrong.

Whatever tiny speed advantages that might possibly be gained under special situations from using a simple old filesystem are completely negated by the many advantages and much increased robustness of a journalled filesystem like NTFS. Why do you think people use journalled systems? To deliberately slow their machines down? Jeez!

As for the idea of using what is effectively an obsolete filesystem on a new dual-core notebook...words fail me!



PS: My wife's Asus notebook also came with the primary partition formatted as FAT32. I've no idea why they do this. First thing I did was convert is to NTFS.

PS: Loose rivets - NTFS also fragments, but the fragmentation has less effect on speed, so defragging all the time isn't so important.
Mac the Knife is offline  
Old 13th Jul 2006, 08:26
  #18 (permalink)  
Thread Starter
 
Join Date: Jul 2000
Location: UK
Posts: 1,528
Likes: 0
Received 3 Likes on 3 Posts
I hadn't realised that the file system could be changed without reformatting.
Background Noise is offline  
Old 14th Jul 2006, 00:05
  #19 (permalink)  
 
Join Date: Jul 2002
Location: CYYC
Posts: 410
Likes: 0
Received 0 Likes on 0 Posts
Originally Posted by Mac the Knife
PS: My wife's Asus notebook also came with the primary partition formatted as FAT32. I've no idea why they do this. First thing I did was convert is to NTFS.
The manufacturers may be doing this to prevent people from locking themselves out of their computer or running into permission issues. If you happen to set the permissions wrong, or forget a password, you're in big trouble under NTFS. With FAT32 you (and any viruses or malware apps running) can get at every file without much trouble.

I know personally I've had cases where after upgrading my WinXP machine and reinstalling the system, I no longer had permissions to open some files. It isn't hard to fix if you know what you're doing, but I don't think the average person will find it easy.
goates is offline  
Old 14th Jul 2006, 11:32
  #20 (permalink)  
Spoon PPRuNerist & Mad Inistrator
 
Join Date: Sep 2003
Location: Twickenham, home of rugby
Posts: 7,398
Received 265 Likes on 173 Posts
The manufacturers may be doing this to prevent people from locking themselves out of their computer or running into permission issues.
Hmmm... Shouldn't the manufacturers be more concerned with securing PCs against attack from the internet?

It's a bit like saying car manfrs don't put locks on their cars against the possibility that someone might lose their keys.

SD
Saab Dastard is offline  


Contact Us - Archive - Advertising - Cookie Policy - Privacy Statement - Terms of Service

Copyright © 2024 MH Sub I, LLC dba Internet Brands. All rights reserved. Use of this site indicates your consent to the Terms of Use.