MULTIMEDIA AND LABORATORY

Module MULTIMEDIA

Become an expert in multimedia systems -images, audio and video - and improve the skills related to multimedia system programming.

General learning objectives in terms of expected learning outcomes.

Knowledge and understanding: The aim of the course is to acquire knowledge that will enable the student to understand the theoretical and physical mechanisms underlying the human visual system, the formation and processing of sound, video and digital images, enhancing the visual quality of digital images and audio quality.
Ability to apply knowledge and understanding: the student will acquire the skills needed to acquire, edit, compress and save a viedeo audio signal. Particularly a part of the course will be related to the study of Matlab software to apply such theoretical knowledge.
Making judgments: Through examples in the classroom, the student will be put into the condition of understanding whether the solutions offered by him meet a certain degree of quality.
Communication skills: The student will acquire the necessary communication skills and technical language skills in the multimedia field.
Learning Skills: The aim of the course is to provide the student with the necessary theoretical and practical methodologies to deal with and solve new problems that arise during a work activity. To this end, several topics will be addressed in lesson by involving the student in the search for possible solutions to real problems.

Classroom lessons

Seminars

Should teaching be carried out in mixed mode or remotely, it may be necessary to introduce changes with respect to previous statements, in line with the programme planned and outlined in the syllabus.

Signals: Introduction to waves, Fourier series, and exercises.

Signals: Types of signals, sampling, Shannon's theorems for sampling and reconstruction, uniform and non-uniform quantization, SQNR (Signal-to-Quantization Noise Ratio), and RMS (Root Mean Square).

Signals: Dithering, types of dithering: random, ordered, error diffusion; Floyd-Steinberg algorithm, Jarvis algorithm.

Signals: Discrete transforms, construction method, Haar transform, Walsh/Hadamard transform, and Fourier transform.

Signals: MATLAB laboratory on the discussed topics.

Digital Video: Aspect Ratio; Resolution; Interlacing; Analog and digital transmission and recording formats.

Digital Video: Analog-Digital Conversion; Part II - Common Registry, Artifact and Drop Errors; Part III - Projections of 3D and 2D space, CAHV model, Matlab lab on the projections, introduction to the most common motion areas.

Digital Video: Matlab Laboratory: Comparison of Ideal and Empirical Motion Fields, Calculation and Visual Analysis of Generic Motion Fields. 4-Parameter and 6-Parametric Camera Movement Models. Motion Estimator Criterion: Displaced Frame Difference. Block matching algorithms: exhaustive and three-step search. Feature matching algorithms: FAST.

Digital Video: Stabilization. Digital Stabilization Systems: Motion Vector Integration, Frame Position Smoothing and Kalman Filtering; Examples of image deformation and chromatic stabilization. Matlab Laboratory: motion detection with background subtraction; application example of the Kalman filter; example of video stabilization application using FAST algorithm.

Digital Video: MPEG-1, MPEG-2, MPEG-4, H.264 video formats. 3D Scan - laser scanning (triangulation, structured light, flight time, photographs): hardware, methods and examples.

Rust seminars.

Should teaching be carried out in mixed mode or remotely, it may be necessary to introduce changes with respect to previous statements, in line with the programme planned and outlined in the syllabus.

The laboratory module focuses on the implementation of the main algorithms for multimedia processing, which are studied in the theoretical module.

The employed programming language are Python and Matlab.

Digital Image Processing, Third Edition, Rafael C. Gonzalez, Richard E. Woods, Ediz. Pearson, Prentice Hall

Audio e multimedia 3 ed., di Lombardo, Valle, Apogeo ISBN: 9788850327621

Video Processing and Communications, Wang, Osternmann, Zhang, Prentice Hall, Pearson Education, ISBN: 0-13-017547-1

The examination is held in italian language according the rules described in the italian version of this section.

Erasmus students and other non-italian speakers may ask to take an oral exam.

For the assignment of grades for individual assessments, the following criteria are typically followed:

Fail: The student has not acquired the basic concepts and is unable to complete the exercises.

18-23: The student demonstrates a minimal mastery of the fundamental concepts; their ability to present and connect content is modest, and they can solve simple exercises.

24-27: The student shows a good grasp of the course content; their ability to present and connect the content is good, and they solve exercises with few errors.

28-30 with honors: The student has acquired all course content and can present them comprehensively with a critical perspective; they solve exercises completely and without errors

The assessment of learning may also be conducted remotely if the conditions require it.

Learning will be assessed by completing a software project agreed upon with the instructor.

The assessment of learning may also be conducted remotely if the conditions require it.

Questions:

• Explain the origin of the acronym "SECAM" in the analog TV format of the same name, and provide a brief description of how it works.
• What modulation system does SECAM use? Are there any differences compared to the modulation system used in NTSC and PAL?
• Which color space is used in the SECAM analog TV format? What do the three channels of this color space represent, and how are they calculated?
• What are the main advantages and disadvantages of the SECAM analog TV format?

The software projects will focus on course topics, and students may be asked to implement:

• Algorithms for enhancing the quality of multimedia content.
• Algorithms for processing audio/images/videos.
• Algorithms for encoding and compressing multimedia information.
• Algorithms for extracting information related to the semantics of multimedia content.