The Mac Observer

Skip navigational links

The Devil's Advocate - TMO Scoop: Mac OS 10.5 UI, Finally Resolution Independent?
by - January 25th, 2006

Looks like Apple may finally be catching up with Windows in the User Interface department in one sorely long overlooked area -- User Interface (UI) resolution independence.  On June 24, 2004, Apple filed patent application no. 20050285965 for a "User-Interface Design."

The patent application noted that "it would be beneficial to provide a means to specify the design of a graphical user interface object independent of its display resolution."

Indeed it would.  I wrote about this quite a while back. It would be very useful to change the size of UI widgets (e.g., menus, scroll bars, buttons, etc.) on displays with different resolutions for more accurate, more legible and clearer screen displays. Microsoft provided users with the ability to scale the UI to variable resolutions back with Windows 95. Although the Windows 95 UI scaler is a bit choppy in how it re-rasters UI widgets, it gets the job done. But it looks like Apple's take on this improves on the Windows version by interpolating between preferred resolutions instead of just up/down-scaling.

How Apple's Version Work

Apple's take on UI scaling seems to involve specifying some non-resolution specific attributes for each UI widget in "recipe" XML files, and then to provide the OS display engine with "hints" at various preferred resolutions.  The render engine, presumably Quartz, may then use these recipe files to render UI widgets at varying resolutions.  Here's an excerpt from the application:

[G]raphical objects are defined in terms of a collection of resolution independent attributes. [...] each attribute may be associated with a plurality of values, thereby permitting the designer to optimize the object's design for each of a specified number of resolutions. [...] [I]f the actual displayed resolution of the graphical object is between two of the resolutions specified by the designer, the rendering engine may interpolate between the two values -- a technique that generally provides a significantly improved display over prior art up-sampling or down-sampling techniques.

Apple has a GUI design application to facilitate generating the recipe files.  Here's a screen shot from the patent application:


GUI Attribute Recipe Application

As you select any UI widget, you get various attribute panels where you can select the parameters that specify how the widget is to behave and look at various resolutions, which in turn will create the UI resolution independent recipes. Here are a few screen shots of the parameter panels from the patent application:


Parameter Panel for Outside Shadow for GUI Attribute Recipe Application


Parameter Panel for Outlines for GUI Attribute Recipe Application


Parameter Panel for Figures for GUI Attribute Recipe Application

Apparently, these recipe files may then be used by the display engine to interpolate the screen UI to any number of resolutions. In addition, it seems that the recipe files can be used not only to create hints for various screen resolutions, but that they can also change the appearance of the UI widgets. It's not clear if Apple will release this tool to developers, but it would be a boon to UI tweakers.

A New Trend

If Apple does finally come out with a screen resolution independent UI, we might experience a renaissance in screen purchases. Why you ask? Two reasons: Laptops and love of typography. First, for quite sometime Apple laptops have trailed PCs in maximum offered resolutions.  Even with the introduction of the new HD displays on its laptops, Apple still trails Dell, which offers resolutions up to 1920x1200 on their laptops (while Apple's max out at 1680x1050). One reason why is that without a scalable UI, Apple simply cannot push resolutions any higher without making the screen type and elements too small.

The other, perhaps more significant, factor may be Steve Jobs' love of typography.  Other than having a scalable UI, there is nothing stopping us from having laser printer-like LCD resolutions. Knowing Mr. Jobs' love of typography, we might expect Apple to release ultra high resolution monitors along or soon after they release a resolution independent UI. And where Apple blazes a trail, the rest of the computer industry often follows. Now might be a good time to start speculating on the futures of the LCD manufacturing companies.

I expect that Mac OS X 10.5 will finally bring UI resolution independence, and usher in higher resolution displays, not only for laptops, but for the desktop as well.   Sadly, Apple is still catching up to Windows over 11 years later, at least in this area. It's strange to see that Apple is still struggling to get its solution in working order having the superior Quartz display technology; i.e., Mac OS X has always used screen resolution independent display PDF. Regardless, here's to better late than never.

[Author's Addendum: Thanks to the guest poster that pointed out that the latest development tools allow you to test some of these UI resolution independent controls. It seems rather buggy, and the interface needs some work. Providing a Windows like ruler so the user can match a real world ruler to the screen would make things easier.]

is an attorney. Please don't hold that against him. This work does not necessarily reflect the views and/or opinions of The Mac Observer, any third parties, or even John for that matter. No assertions of fact are being made, but rather the reader is simply asked to consider the possibilities.

You can send your comments directly to me, or you can also post your comments below.

Most Recent Columns From The Devil's Advocate

The Devil's Advocate Archives

Observer Comments

Show: Subjects Only | Full Comments
Close Name:Guest
Subject: It's already being tested

See how your interface looks like at different resolutions assuming you have the developer items installed.

http://www.macosxhints.com/article.php?story=20060119152725322

Close Name:Guest
Subject: Blast from the past

Wow, scaling up the UI resolution reminds me of the original Mac, where the menu bar, icons, windows, scroll bars, etc. took up a major portion of the screen real estate!!

The Mac hasn't been true WYSIWYG either since the original Mac, where both the screen and printer were 72 DPI (the ImageWriter also supported a 144 DPI non-WYSIWIG mode.)

I'm not sure I want to go back to low-resolution screens, but it would be nice to have screen resolution that's close to printer resolution. I've used IBM's high resolution 4+ megapixel display, and it's amazing how much better everything looks - for example, scans of maps and newspapers are extremely legible.

Close Name:Guest
Subject: Apple's official dev documentation already mention it.

While this is a great article, as the patent give us many new details about how it could be implemented in Leopard, it was already clear in my mind that it was a planned feature for 10.5 , especially after finding that page:

http://developer.apple.com/releasenotes/GraphicsImaging/ResolutionIndependentUI.html

As far as I know, Windows is not really resolution independent, it does enable you to resize the main interface widgets, but there is much more to be done to achieve a true resolution independent UI, and from what I've read, Vista won't improve that.

Close Name:Mikuro Posts: 457 Joined: 15 Jun 2002
Subject: Its early form is in Tiger (sort of)

As the above guest mentioned, you can access Apple's first attempts at this if you have the developer tools installed in Tiger. It's currently a little quirky (which is why it's not a real feature yet, of course), but here are a few quick points I want to make on it:

1. Text scales perfectly, since it's all vector-based to begin with. If you double the size of something with 12-point text, it's basically like looking at 24-point text. Very nice.

2. Resolution controls can be different from application to application. When this feature goes prime-time, I wouldn't be surprised to see it even go window-for-window. I think it's very cool that you don't have to change everything.

3. Bitmapped elements, like buttons, scrollbars, close boxes and most UI elements, appear blocky when blown up (the text on them is perfect, though, as I mentioned above). This is to be expected, of course. It's quite possible that in Leopard, Apple will make all their interface elements vector-based so they'd scale nicely. It's also possible they'll simply pre-render many different bitmapped versions at different sizes, and pick which is appropriate every time it needs to be drawn. They could also just have one bitmapped version rendered at a very high resolution, and scale it down as appropriate. Quartz already has an excellent caching system for this kind of thing built in. Either way, I would expect all scaled elements to look very good when Apple makes this a real feature.

4. There's currently no way to change the resolution of only the content. It's all or nothing (per app). Meaning you can't blow up your web pages in Safari without also blowing up things like the menu bar, the window border, the scroll bars, the toolbar, etc. A bummer from my perspective. Again, this could be changed in its final form. I sure hope so.

5. The fact that the menu bar blows up with everything else kills the feature for me. Already, my menu bar is practically full from edge to edge on my 1280x1024 monitor. Blowing it up means I can't see every menu. I don't want to blow up my menus, so I hope there will be a way to leave the menu bar alone. Again, I hope there will be window-by-window settings for this in the future, which would solve this problem.

Close Name:Guest
Subject: Nice to see some work on quality

Part of the reason there isn't a resolution-independent implementation is that it often LOWERS the quality, not improves it. For icons and bitmaps, if you draw them huge then scale them down, they tend to look "fuzzy", and if you scale them up, "blocky". Look at the latest Java2D implementations when you start adding scale factors to the Graphics2D for how bad things can get. It looks like Apple isn't going to do it until they can do it right, which is nice to see.

By the way, you won't see laserwriter-quality displays until the graphics card, RAM, display connectors, internal memory busses, and, for laptops, battery capacity are all sufficiently improved. It's not just a matter of putting the pixels closer together unless you want an iPod-sized screen.

Close Name:Guest
Subject: Not in Tiger, in 10.5

Quote
Guest wrote:
While this is a great article, as the patent give us many new details about how it could be implemented in Leopard, it was already clear in my mind that it was a planned feature for 10.5 , especially after finding that page:

http://developer.apple.com/releasenotes/GraphicsImaging/ResolutionIndependentUI.html

As far as I know, Windows is not really resolution independent, it does enable you to resize the main interface widgets, but there is much more to be done to achieve a true resolution independent UI, and from what I've read, Vista won't improve that.


From the link you provide:
"Important Note: Resolution Independent UI will not be a user level feature in Tiger and won't be exposed anywhere in the user interface."

If you run the QuartzDebug and play with the settings, first you'll see that it leaves artifacts all over the place. The menus get botched up, random color blotches get introduced. And worse still, when you set scaling back to 1.0, the menu redraws wrong requiring either logging out of your account or rebooting to set it straight. Not only is the user side not ready for prime time, the actual hooks (which is all that Tiger provides) are not yet ready. Still, its a start!

Close Name:Guest
Subject: Bitmaps dont have to be blocky

Quote
Guest wrote:
Part of the reason there isn't a resolution-independent implementation is that it often LOWERS the quality, not improves it. For icons and bitmaps, if you draw them huge then scale them down, they tend to look "fuzzy", and if you scale them up, "blocky". Look at the latest Java2D implementations when you start adding scale factors to the Graphics2D for how bad things can get. It looks like Apple isn't going to do it until they can do it right, which is nice to see.

By the way, you won't see laserwriter-quality displays until the graphics card, RAM, display connectors, internal memory busses, and, for laptops, battery capacity are all sufficiently improved. It's not just a matter of putting the pixels closer together unless you want an iPod-sized screen.


I dont really agree with you. First, the dock shows that you can scale bitmaps really cleanly. It's a matter of starting with a higher resolution. As far as higher resolution screens, most of the laptop battery is taken up by the backlighting, not the extra pixels. Throwing more memory on video cards is no big deal either. Ever since the apple 30" display (and now the dell 30" display) came out, you see a lot more cards out that support dual link like its no big deal. The availablitly of the high res cards at relatively affordable rates will drive the move to laser like displays. The rest of the components will cost only marginally more compared to the cost of the super high rez LCDs.

Close Name:Guest
Subject: It's in Tiger for developpers...Thus probably in 10.5

I'm the guest that posted the Apple developer site link. I'm under the impression that one guest felt the need to correct me with the post entitled "Not in Tiger, in 10.5".

I never said it was a user-end feature in Tiger, but the fact that it's there for developers in itself made it clear (to me) that they are planning to "open it" to users starting with 10.5.

Close Name:ericl Posts: 27 Joined: 25 Jul 2004
Subject: Quartz vs. ClearType

Quartz is great for LCD but text still seems fuzzy. Unfortunately using Windows at work with an LCD screen and ClearType enabled is extremely clear. Wish it could be that clear on my Mac.

Close Name:Guest
Subject: Windows Not Resolution Independent

I don't thnk you know what resolution independent means if you think Window's is. Window's has a feature that can scale based on a DPI setting, but the layout of wiindows and pages definetly takes a hit.

Close Name:Biff Posts: 1479 Joined: 08 Apr 2004
Subject:

"Even with the introduction of the new HD displays on its laptops, Apple still trails Dell, which offers resolutions up to 1920x1200 on their laptops (while Apple's max out at 1680x1050). One reason why is that without a scalable UI, Apple simply cannot push resolutions any higher without making the screen type and elements too small."

Yeah again you make it sound like Windows really does have resolution independent UI, but it doesn't. The reason Dell offers such high resolution displays is because it gives them big numbers to put on their spec sheets. They don't care about whether the UI is readable at that resolution. Apple on the other hand does.

Close Name:Brutno Posts: 198 Joined: 28 Aug 2002
Subject: Free Ruler

"Providing a Windows like ruler so the user can match a real world ruler to the screen would make things easier."

John,

Would this help?

http://www.pascal.com/software/freeruler/

Close Name:coaten Posts: 3071 Joined: 10 Oct 2001
Subject:

Quote
ericl wrote:
Quartz is great for LCD but text still seems fuzzy. Unfortunately using Windows at work with an LCD screen and ClearType enabled is extremely clear. Wish it could be that clear on my Mac.


That must be subjective. I use Windows with a HP LCD and text looks like mud - way inferior to the 20in iMac LCD I'm looking at right now.

A matter of set-up, perhaps?

Close Name:Guest
Subject: Windows scaling is terrible

The scaling that windows does is terrible. Almost everyone I know with a high res windows laptop hates "all the small text". If you turn the scaling on, there are so many bugs that all web pages look like crap, applications have buttons drawn wrong, and STILL much of the text in applications is small. Since I routinely help friends and relatives buy computers, I always have to make sure they get the lower res screen. I once bought a high res dells as a replacement for 4 yr old IBM laptops, only to get the dell back, as the text was too hard to read. I agree with Biff.

Close Name:Guest
Subject: Resolution independence in Windows is a joke

I am a systems administrator dealing with this very issue. All of my users have been upgraded to 1400 x 1050 resolution tablet computers, and the vast majority of them are complaining because the type is too small. You can increase the size of certain window elements, but to increase the type in a main window your application has to support it directly. Most don't, and those that do have different and confusing ways to change the type size, making it a tedious task to make things readable.

11 years behind Windows, my ass. The anti-Apple bias is pretty thick in this post.

Close Name:Guest
Subject: Not really

Quote
Brutno wrote:
"Providing a Windows like ruler so the user can match a real world ruler to the screen would make things easier."

John,

Would this help?

http://www.pascal.com/software/freeruler/


With Windows, you line up the screen ruler to a real ruler, and then Windows computer the correct screen DPI, all with one single drag of the ruler. Just showing a screen ruler does not accomplish that.

Close Name:deasys Posts: 296 Joined: 08 Apr 2003
Subject: Wrong from the get-go

Quote
Looks like Apple may finally be catching up with Windows in the User Interface department in one sorely long overlooked area -- User Interface (UI) resolution independence


What a stupid comment.

No version of Windows provides a resolution-independent interface.

Close Name:JulesLt Posts: 136 Joined: 06 Jul 2005
Subject:

Et tu. But then at work we use the cheapest Dell LCD you can buy.

(I'm aware higher end Dell use the same panels as the Cinema Display).

IMO - the biggest problem with this is the increase in development cost - validating things look correct at different resolutions, etc.

Close Name:Guest
Subject:

Quote
deasys wrote:
Quote
Looks like Apple may finally be catching up with Windows in the User Interface department in one sorely long overlooked area -- User Interface (UI) resolution independence


What a stupid comment.

No version of Windows provides a resolution-independent interface.


Well since you say so, it must be so. Despite them having the ruler feature that sets the DPI resolution for the display. We have it on your authority. Why didn't you say so sooner.

Close Name:Guest
Subject: Agreed - a stupid way to start the article

"Looks like Apple may finally be catching up with Windows in the User Interface department in one sorely long overlooked area..."

This is inflammatory nonsense. Yes, resolution-independence is a good idea, and Windows does this better, although not without some serious caveats and bugs.... HOWEVER, the phrase "Apple may be finally catching up with Windows in the User Interface department" implies that Windows (Microsoft?) has always (or at least for a long enough time to justify the word "finally") been far ahead of Apple (the Macintosh? the Apple //gs? the Newton? the Lisa?) in the "User Interface department," while nothing could be further from the truth.

It is also true that the Macintosh has adopted a few features that showed up first on Windows (e.g. the arrow icon on aliases, persistent menus), but on the whole the design and feature migration has been primarily in the opposite direction. I forget who first said it, but the phrase "All modern computers are Macintoshes" has a fair amount of truth to it! And in general, the Macintosh of today seems to resemble the Windows machine of the future...

A more reasonable phrase would be "Windows does have a few good features that are missing from the Macintosh, and resolution-independence is one of them..."

Another Windows feature I would like to see on the Mac is the floppy-like handling of CD-RW discs.

Close Name:Guest
Subject: Free Ruler

You obviously didn't download and try the application, as that is exactly what it does.

Close Name:Guest
Subject: I agree

I use Excel 2003 at work on a Windows 2000 system, and at home on an XP system and have my resolution set to 1280x1024 on both systems. Apparently, Microsoft must not have thought anyone would be using Excel at that resolution (or highter) since there are bugs in many of their dialog boxes that result in many of the tabs being obscured (the cell format dialog box most prominent).

So much for "resolution independence".

Close Name:Guest
Subject:

Quote
Guest wrote:
You obviously didn't download and try the application, as that is exactly what it does.


You obviously have no clue what I'm talking about. Free ruler a) doesn't let you simply drag and "stretch" the units out to a to match a real world ruler (it lets you stretch the length of the ruler, NOT THE UNITS THAT COMPRISE THE RULER). And, b) it only has a unit conversion pref that lets you type in different dpi settings THAT AFFECT THE RULER ONLY. So a) it's interface is not as good as windows, and b) IT DOES NOT AFFECT THE REST OF THE OPERATING SYSTEMS EFFECITIVE DPI SETTING SO ALL OTHER PROGRAMS KEEP RUNNING AT THE DEFAULT DPI SETTING---now wait for it...--IT DOES NOT AFFECT HOW ANY OTHER APPS OR THE SYSTEM DRAWS STUFF.

The windows ruler lets you stretch it to match the real world, and get this, changes the default dpi setting for the entire operating system and draws all other programs to match that new dpi setting.

So before you go spouting off like the arrogant jerk you apparently you are, why dont you try the feature in windows and buy a clue as to what it does.

Close Name:Guest
Subject: Text is fuzzy on some monitors

Quote
coaten wrote:
Quote
ericl wrote:
Quartz is great for LCD but text still seems fuzzy. Unfortunately using Windows at work with an LCD screen and ClearType enabled is extremely clear. Wish it could be that clear on my Mac.


That must be subjective. I use Windows with a HP LCD and text looks like mud - way inferior to the 20in iMac LCD I'm looking at right now.

A matter of set-up, perhaps?


I agree with ericl -- text is very fuzzy for me on my Planar 20" monitor, no matter what form of font smoothing I choose. But it's much better -- almost perfect -- on my Powerbook. So, no doubt the monitor plays a part in this, but it is disappointing to me that OS X, which is superior to Windows in so many ways, falls far short in this area on my monitor.

Comment on this Article


You cannot edit your comments.   You cannot delete your comments.

Comments are currently closed. Please email the author instead.


Recent Headlines - Updated February 9th

Tue, 1:31 PM
Jeff Gamet's Blog - Macworld Expo: It’s Our Show, Not Apple’s
10:38 AM
Quick Look Review - Texas Tea for the iPhone and iPod touch
10:25 AM
News - Apple Rolls Out Aperture 3 Video Tutorials
10:00 AM
Hot Forum Topic - Backing Up Your iPhoto Library
9:35 AM
Product News - Notebook, iThoughts Add TextExpander touch Support
9:00 AM
Hidden Dimensions - The Killer Surprises Waiting for Steve Ballmer
8:50 AM
Product News - Aperture 3 Adds Faces Support, More [Updated]
8:30 AM
TMO Quick Tip - Fixing iPhone and MobileMe Sync Headaches
8:12 AM
News - Apple Store Offline, Rumors Point to New Laptops
8:00 AM
TMO Appearances - TMO’s Bryan Chaffin and the Atomic Love Bombs Perform During Macworld Expo
Mon, 5:37 PM
News - Juniper Readies Software to Improve Cell Carrier Networks
5:17 PM
Macworld Expo - Macworld Expo 2010 Hess Party List Goes Online

The Mac Observer Reader Specials

  • __________
  • Buy Stuff, Support TMO!
  • Podcast: Mac Geek Gab
  • Podcast: Apple Weekly Report
  • TMO on Twitter!