ChapterOneIntroduction
andinternet.Thedataandinformation
are
commonlymixedwithdifferentimages,
soundandmusic.Thetraditionalwayofpassing
information
hasbeen
changedbyits
nature.Thus
multimodaldiscourseanalysisisopened
textisavaluable
toalargerangeoftheup to—date
resources.Amongthesethemovie
resourceofOurworldexperiences.
ThetraditionalpointofviewabouttheliteracyhastobebroadenedbecauseoftheemergenceofmultipleconstructionLondon
modesof
communication,the
more
complexofmeaning
andthe
linguisticandculturaldiversity,whicharefoundbytheNew
theexplorationofthe
Group(1996).Through
toenhancethe
MDAofthemovieshots,this
thesispaperaimsunderstandings
of
oftheprocessofcommunicationwhich
involvesthespatial
andtemporaldynamics
visual
semiosis.Alsoitaims
topavethe
wayforthefurtherexplorationoftheand
touchare
further
communicationwheresight,hearing,taste,smell,
sensory
sourcesforand
which
deals
with
human—human
ofgesture,
multimodal
structure
communication
functions
of
includingspeech-gesturesystems,semioticsface-to.face
and
communication,emotionalrelationsand
interculturalvariation.
Inthisageofmultimedia,thereis
an
increasingawarenessthatmeaningcouldnot
bemadewitlllanguagealoneinmostcases.Andthismustbeunderstoodbytaking
language
as
social
semiotic(Halliday,1994)and“taking
as
into
account
as
many
modalitiesofcommunicationwe
a
cansystematicallydescribe”(Martin
andRose,
2003).Thisis
because,“weliveinmultimodalsociety,whichmakesmeaningthrough
are
theCO—employmentofsemioticof
resources”(Lim,2004).Thereand
van
productiveaccounts
image(O’Toole
1994;KressLeeuwen1996;Goodman1996;Jewitt
and
Oyama
2001;Stenglin
andIdema
2001),music
a
andsound(Van
hasbecome
a
Leeuwen1
999)and
action(Martinec1998,2000).As
a
result,MDA
veryexcitingresearch
frontier.There
is
pressingneedtounderstandthedynamicsofsemiosisinmultimodal
discoursesuch
as
film.Academicdisciplinessuch
as
linguistics,which
focus
on
-
3
-