Real-time Video Effects Using Programmable Graphics Cards

Real-time Video Effects Using Programmable Graphics Cards

Real-time Video Effects Using Programmable Graphics Cards Master of Science Thesis Klas Skogmar [email protected] Klas Skogmar, Lund Institute of Technology Introduction Graphics cards have much computing power but are only used by 3D

applications Video and image editing programs often needs to perform per pixel operations that are ideal for graphics cards Klas Skogmar, Lund Institute of Technology Problems How can graphics cards be used for displaying and altering video?

What kinds of effects are suitable for a 3D environment? Is it possible to speed up effects by using the graphics card? How are the transfer rates affecting the system? How much disc space is required and how does this affect the system? Klas Skogmar, Lund Institute of Technology Programmable graphics cards Graphics cards can do massive parallel

calculations 3D developers required more flexibility 3D card producers introduced Vertex shaders and Pixel shaders Makes it possible to program graphics cards in a similar way to processors Klas Skogmar, Lund Institute of Technology Effects on graphics cards

Color correction Masking Color keying Compositing Transitions Painting

3D effects Klas Skogmar, Lund Institute of Technology High resolution challenges HDTV standard 1080p requires throughput of 156 Mb/sec uncompressed. Current broadcasts takes approximately 30 Mb/sec uncompressed Challenges: Disc space Transfer speed Other problems (e.g. dynamic range)

Klas Skogmar, Lund Institute of Technology Working practice

Real-time Expensive Scanning film Many formats High resolution Proxies and AOI Specialized hardware Klas Skogmar, Lund Institute of Technology Available technologies Dedicated hardware

OpenGL (Imaging subset) DirectX (Direct3D and DirectShow) Quicktime ATIs and Nvidias Klas Skogmar, Lund Institute of Technology DirectShow

Microsofts media development environment Built up of filters each with its own task Filters are assembled in a filter graph Is supported by many video and image formats Klas Skogmar, Lund Institute of Technology My program Built using MFC Uses a DirectShow filter

Shows how DirectShow can be used Klas Skogmar, Lund Institute of Technology Performance My program was slow ATI has developed a program that is fast (uses VMR-9) Serious Magics Texture Download Benchmark

Matt Craigheads program Klas Skogmar, Lund Institute of Technology Performance Results: ATIs program shows the potential adding effects do not give visible frame drops The other programs shows the transfer speed from the graphics card to the processor it is not enough, but driver

updates enhances the performance Klas Skogmar, Lund Institute of Technology Conclusions It is already a technique that can be used! Drivers has to be enhanced to allow the modifications to be written back to memory Graphics cards are more flexible than dedicated hardware Effects have to be rewritten Many effects are more suitable to do using graphics cards

Klas Skogmar, Lund Institute of Technology Conclusions The transfer to and from disc can be a problem There is a need for modules (e.g. DirectShow filters), that makes it easy to use programmable graphics cards Klas Skogmar, Lund Institute of Technology

Recently Viewed Presentations

  • Prescription Drug Abuse EPI Profile Presentation

    Prescription Drug Abuse EPI Profile Presentation

    Arrest Rates, per 1,000 Population, for Possession and Sale/Manufacture of "Other Drugs" (Barbiturates and Benzedrine), Indiana and U.S. (Uniform Crime Reporting Program, 1999-2007) Source: National Archive of Criminal Justice Data, Inter-university Consortium for Political and Social Research, University of Michigan,...
  • Consumer Division - YPLEA

    Consumer Division - YPLEA

    Video is the primary application that drives Internet usage. Regular web surfing, e-mail, photos, and even music downloads are unlikely to generate a usage bill. You can log on to Northwestel's website (www.nwtel.ca) Sign-up for automatic e-mail usage notification service
  • Strategic Management- Chapter Seven

    Strategic Management- Chapter Seven

    HOSTILE TAKEOVER. Unfriendly takeover that is undesired by the target firm ... Reduce the negative effect of an intense rivalry on a firm's financial performance. Reduce a firm's dependence on one or more products or markets. ... STRATEGIC MANAGEMENT- CHAPTER...
  • Be. - Rail Baltica

    Be. - Rail Baltica

    These rules are enforced along with all national public procurement rules, and apply to every employee and procurement commission, as well as the Beneficiaries and Implementing Bodies of the Rail Baltica project. Each of us must comply with the laws,...
  • Task Group G Report - IEEE Standards Association

    Task Group G Report - IEEE Standards Association

    Matthew B. Shoemake Task Group G Chairperson November 15, 2002 Letter Ballot 49 Resolution Resolved all comments from Letter Ballot 49 Comment resolutions in document 11-02-711r8 Of technical comments: 60 Accepted 29 Countered 58 Rejected Balloting History State of the...
  • Character Counts!

    Character Counts!

    (3 - 5 sentences) 2. Exposition: Give background information Introduce the conflict, setting, and characters (set the scene) Thoughts and feelings 7 sentences Types/Samples of Hooks Types of hooks: Quote - it can be a direct quote from a book,...
  • EYC Environmental Youth Connections Connie Abert, Waupaca County

    EYC Environmental Youth Connections Connie Abert, Waupaca County

    Connie Abert, Waupaca County UWEX & Gretchen Marshall, UWSP JCEP Conference April, 2011 University of Wisconsin, U.S. Department of Agriculture and Wisconsin counties cooperating. UW-Extension provides equal opportunities in employment and programming including Title IX and ADA.
  • Figure 27.3d-f Microscopic anatomy of selected endocrine organs.

    Figure 27.3d-f Microscopic anatomy of selected endocrine organs.

    Figure 27.3a-c Microscopic anatomy of selected endocrine organs.. Colloid-filled. follicles. Follicular. cells. Thyroid gland (360 ) Parathyroid gland (375 ) Pancreatic islet (205 ) Oxyphil. cells. Parathyroid