Click here to close now.

Welcome!

.NET Authors: VictorOps Blog, Elizabeth White, Liz McMillan, Greg O'Connor, Jason Bloomberg

Related Topics: .NET

.NET: Article

WinFS: The Windows Storage Platform of the Future

How to Write Applications that Take Advantage of WinFS

The next version of the Windows operating system (codenamed "Longhorn") has a new storage subsystem (codenamed "WinFS"). In this article, we will try to understand the need for "WinFS"; define "WinFS", its type system, and its data model; and learn how to write applications that take advantage of "WinFS".

Why Does Windows Need a New Storage Subsystem?
The hardware industry is confidently striding towards conquering the 3T challenge (a teraflops processor, a terabyte hard disk, and a terabits per sec bandwidth). Increase in the size of hard disk storage has been complemented by the exponential increase in the production of digital data. The amount of digital data being born daily is so phenomenal that the pen, the paper, and the typewriter have achieved the status of endangered stationery. Digital data is stored by operating systems on magnetic media - like hard disks. Windows uses file systems like NTFS and FAT32 to organize data on hard disks that are divided into logical drives. Each drive has a root folder, which can have one or more files and folders. Data is stored in files.

Data has personality. It can be documents (text, DOC, PDF, RTF, PostScript formats), images (bitmap, GIF, JPEG, PNG, WMF formats), audio (WAV, MP3, WMA, AIFF, formats), video (MOV, MPEG, AVI, ASF, QuickTime formats), and more. Along with data, these formats also store rich metadata. NTFS and FAT32 are capable of reading only basic metadata from files, like their name, size, date modified, and type (derived from the file extension). So, if I want to search all songs of a particular artist, I can't do it just by using the file system. I'll need a specialized application like Windows Media Player, which is capable of reading the rich metadata provided by all audio files.

What is "WinFS"?
"WinFS" is the Windows storage platform of the future. It solves many of the problems associated with current file systems by storing data and its metadata together. This way data can be organized, searched, shared, and related depending upon what it is and not what it's called (filename)! "WinFS" also makes it easy to deal with non-file-backed data like personal contacts, e-mail messages, and event calendar.

"WinFS" allows a user to organize data with great flexibility. Using "WinFS", a user can group data according to common characteristics, create a customized containment hierarchy to hold data, and associate one piece of data to another via relationships. This organizational flexibility provides the user with greater flexibility when searching for data. The user can search for data based on its attributes, its relationship with other data, and by its storage location.

Searching Data
Because of its ability to organize data based on various parameters, "WinFS" presents data as a directed acyclic graph (DAG) instead of as a tree (as in NTFS and FAT32). In NTFS and FAT32, since data is stored as a tree, it can be located based only on a single criteria (its directory path), while in "WinFS", since data is stored as a graph it can be searched based on multiple criteria.

Sharing Data
"WinFS" facilitates data sharing among various applications by giving file-backed data (documents, audio video, media, and so on) as well as non file-backed (e-mail, contacts, appointments, and so on), permanent residency status in the operating system and providing a unique API to access them. Now different applications can use these common pieces of data without worrying about maintaining individual data stores and the associated synchronization.

WinFS Building Blocks
Figure 1 illustrates the various building blocks of "WinFS".

Core "WinFS"
"WinFS" does not supplant NTFS; rather, it utilizes the basic file system services of NTFS. The core building block of "WinFS" includes the relational storage engine that provides file system services like ACL support, import/export, and quota management.

Data Model
"WinFS" defines a rich data model that resides on top of a relational storage engine. "WinFS" represents a piece of data (item) as a tuple in a relation. The attributes of the tuple describe the piece of data. Items can be related to each other by defining relationships between the tuples. "WinFS" also provides the ability to extend items and relationships.

Schemas
"WinFS" has built-in schemas to understand the rich metadata associated with your data. Some of the built-in schemas are for common data like documents, e-mail, contacts, appointments, tasks, and more. "WinFS" also allows you to write custom schemas for your own data.

"WinFS" provides certain services like synchronization and rules. These services are layered on top of core "WinFS" and provide "WinFS" with extended functionality. For example, the synchronization service enables you to synchronize two or more "WinFS" stores.

APIs
"WinFS"provides support for multiple programming models: object-oriented, relational, and XML based. "WinFS" can also be programmed using the Win32 API.

"WinFS" Type System Basics
"WinFS" is a "strongly typed" storage system. All data stored in "WinFS" is typed; that is, it is an object of some "WinFS" type. To understand the "WinFS" type system, we first have to understand the following four concepts:

  • Items: All data is stored in WinFS  as a type specialized from Item (System.Storage.Item). Examples of types that derive from the Item are: Contact, Document, Task, and Event (all of which are found in the System.Storage.Core namespace)
  • ScalarTypes: An atomic piece of information that describes an item.
  • NestedTypes: A set of information that can be stored about an item. A nested type can have other nested types and scalar types in it.
  • Relationships: Relate one item (source) to another (target). Relationships can be of three types:
    - Holding relationship: The source controls the lifetime of the target. These relationships are many-to-many, that is, a source can "hold" multiple targets and a target can be "held" by multiple sources. If a target looses all sources, it's deleted.
    - Reference relationship: Similar to a holding relationship but without the lifetime management of the target.
    - Embedding relationship: The source embeds the target. Strictly one-to-one.

Programming "WinFS"

In this section, we'll take a brief look at the object-oriented managed API provided by "WinFS". This API allows us to search, relate, and act upon data stored by WinFS

.An installation of Longhorn will have a single instance of "WinFS" service running on it. A "WinFS" instance can maintain multiple data stores. Each data source is referenced by its UNC path syntax as shown below:

\\<machine-name\<data-store-name>

All "WinFS" instances have a default store (DefaultStore). The default store on your "Longhorn" system will be called:

\\localhost\defaultstore

To program "WinFS", you have to get hold of an ItemContext object. This is done by calling the static Open method of the ItemContext class. The method is passed the UNC path of the store you want to program. If you pass nothing, the ItemContext refers to the default store.

All the types that are required to program "WinFS" can be found in three assemblies: System.Storage. dll, System.Storage.Schema.dll, and WinCorLib.dll.

As an example, Listing 1 is code that prints out all folders in the default store.

A very useful class provided by "WinFS" is the ItemSearcher (System.Storage.ItemSearcher) class, which allows you to search for items in a particular item type. Each item type (for example, Contact, Document, Folder, Event, and so on) has a static method called GetSearcher that takes in the ItemContext object and returns the ItemSearcher. Using the ItemSearcher, you can search for the items you need.

For example, Listing 2 uses the ItemSearcher to search for all documents whose title begins with the string 'Result'.

Conclusion
In this brief survey of "WinFS", we have seen that the future of data is with context-based storage systems. "WinFS" will provide the basis on which advanced data-mining tools are going to be built for the personal computer.

More Stories By Mujtaba Syed

Mujtaba Syed works as a software architect with Marlabs Inc. He is an MCSD
(early achiever) and loves to speak about and write on Microsoft .NET. Mujtaba has been programming the Microsoft .NET Framework since its beta 1 release. His current interests are focused on Longhorn.

Comments (2) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
Mujtaba Syed 06/08/04 03:11:22 PM EDT

It''s corrected now.

Mujtaba Syed 06/08/04 02:29:18 PM EDT

Somehow the online version is showing WinFX at all places it should show WinFS! We will get this rectified ASAP. Thanks.

@ThingsExpo Stories
SYS-CON Events announced today that ActiveState, the leading independent Cloud Foundry and Docker-based PaaS provider, has been named “Silver Sponsor” of SYS-CON's DevOps Summit New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. ActiveState believes that enterprises gain a competitive advantage when they are able to quickly create, deploy and efficiently manage software solutions that immediately create business value, but they face many challenges that prevent them from doing so. The Company is uniquely positioned to help address these challenges thro...
SYS-CON Events announced today that Vitria Technology, Inc. will exhibit at SYS-CON’s @ThingsExpo, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Vitria will showcase the company’s new IoT Analytics Platform through live demonstrations at booth #330. Vitria’s IoT Analytics Platform, fully integrated and powered by an operational intelligence engine, enables customers to rapidly build and operationalize advanced analytics to deliver timely business outcomes for use cases across the industrial, enterprise, and consumer segments.
SYS-CON Events announced today that Alert Logic, the leading provider of Security-as-a-Service solutions for the cloud, has been named “Bronze Sponsor” of SYS-CON's 16th International Cloud Expo® and DevOps Summit 2015 New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY, and the 17th International Cloud Expo® and DevOps Summit 2015 Silicon Valley, which will take place November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that kintone has been named “Bronze Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY, and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. kintone promotes cloud-based workgroup productivity, transparency and profitability with a seamless collaboration space, build your own business application (BYOA) platform, and workflow automation system.
SYS-CON Events announced today that Akana, formerly SOA Software, has been named “Bronze Sponsor” of SYS-CON's 16th International Cloud Expo® New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Akana’s comprehensive suite of API Management, API Security, Integrated SOA Governance, and Cloud Integration solutions helps businesses accelerate digital transformation by securely extending their reach across multiple channels – mobile, cloud and Internet of Things. Akana enables enterprises to share data as APIs, connect and integrate applications, drive part...
SYS-CON Events announced today that CommVault has been named “Bronze Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY, and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. A singular vision – a belief in a better way to address current and future data management needs – guides CommVault in the development of Singular Information Management® solutions for high-performance data protection, universal availability and sim...
SYS-CON Events announced today that SafeLogic has been named “Bag Sponsor” of SYS-CON's 16th International Cloud Expo® New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. SafeLogic provides security products for applications in mobile and server/appliance environments. SafeLogic’s flagship product CryptoComply is a FIPS 140-2 validated cryptographic engine designed to secure data on servers, workstations, appliances, mobile devices, and in the Cloud.
SYS-CON Events announced today that StorPool Storage will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. StorPool is distributed storage software that allows service providers, enterprises and other cloud builders to run data storage on standard x86 servers, instead of using expensive and inefficient storage arrays (SAN).
SYS-CON Events announced today that Site24x7, the cloud infrastructure monitoring service, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Site24x7 is a cloud infrastructure monitoring service that helps monitor the uptime and performance of websites, online applications, servers, mobile websites and custom APIs. The monitoring is done from 50+ locations across the world and from various wireless carriers, thus providing a global perspective of the end-user experience. Site24x7 supports monitoring H...
SYS-CON Events announced today that B2Cloud, a provider of enterprise resource planning software, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. B2cloud develops the software you need. They have the ideal tools to help you work with your clients. B2Cloud’s main solutions include AGIS – ERP, CLOHC, AGIS – Invoice, and IZUM
SYS-CON Events announced today that Intelligent Systems Services will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Established in 1994, Intelligent Systems Services Inc. is located near Washington, DC, with representatives and partners nationwide. ISS’s well-established track record is based on the continuous pursuit of excellence in designing, implementing and supporting nationwide clients’ mission-critical systems. ISS has completed many successful projects in Healthcare, Commercial, Manufacturing, ...
SYS-CON Events announced today that Vicom Computer Services, Inc., a provider of technology and service solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. They are located at booth #427. Vicom Computer Services, Inc. is a progressive leader in the technology industry for over 30 years. Headquartered in the NY Metropolitan area. Vicom provides products and services based on today’s requirements around Unified Networks, Cloud Computing strategies, Virtualization around Software defined Data Ce...
SYS-CON Events announced today that Tufin, the market-leading provider of Security Policy Orchestration Solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. As the market leader of Security Policy Orchestration, Tufin automates and accelerates network configuration changes while maintaining security and compliance. Tufin's award-winning Orchestration Suite™ gives IT organizations the power and agility to enforce security policy across complex, multi-vendor enterprise networks. With more than 1...
SYS-CON Events announced today that Optimal Design, an Internet of Things solution provider, will exhibit at SYS-CON's Internet of @ThingsExpo, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Optimal Design is an award winning product development firm offering industrial design and engineering services to the consumer, medical, and defense markets.
SYS-CON Events announced today that MangoApps will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY., and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides private all-in-one social intranets allowing workers to securely collaborate from anywhere in the world and from any device. Social, mobile, and easy to use. MangoApps has been named a "Market Leader" by Ovum Research and a "Cool Vendor" by Gartner...
SYS-CON Events announced today that Cloudian, Inc., the leading provider of hybrid cloud storage solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Cloudian, Inc., is a Foster City, California - based software company specializing in cloud storage software. The main product is Cloudian, an Amazon S3-compliant cloud object storage platform, the bedrock of cloud computing systems, that enables cloud service providers and enterprises to build reliable, affordable and scalable cloud storage solu...
SYS-CON Events announced today that Gridstore™, the leader in hyper-converged infrastructure purpose-built to optimize Microsoft workloads, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Gridstore™ is the leader in hyper-converged infrastructure purpose-built for Microsoft workloads and designed to accelerate applications in virtualized environments. Gridstore’s hyper-converged infrastructure is the industry’s first all flash version of HyperConverged Appliances that include both compute and storag...
SYS-CON Events announced today that Creative Business Solutions will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Creative Business Solutions is the top stocking authorized HP Renew Distributor in the U.S. Based out of Long Island, NY, Creative Business Solutions offers a one-stop shop for a diverse range of products including Proliant, Blade and Industry Standard Servers, Networking, Server Options and Care Packs. As a trusted supplier, CBS guarantees quality controlled stock levels thanks to an Auto...
How is unified communications transforming the way businesses operate? In his session at WebRTC Summit, Arvind Rangarajan, Director of Product Marketing at BroadSoft, will discuss how to extend unified communications experience outside the enterprise through WebRTC. He will also review use cases across different industry verticals. Arvind Rangarajan is Director, Product Marketing at BroadSoft. He has over 19 years of experience in the telecommunications industry in various roles such as Software Development, Product Management and Product Marketing, applied across Wireless, Unified Communic...
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!