当前位置：首页 > news >正文

MovieNet（A holistic dataset for movie understanding）：面向电影理解的多模态综合数据集与工具链

news 2025/10/19 9:27:12

project地址：https://movienet.github.io/

github地址：https://github.com/movienet

arxiv地址：https://arxiv.org/pdf/2007.10937

1. 摘要

MovieNet 是 2020 年 7 月 1 日发布的电影理解综合数据集，核心优势在于海量数据（含 1100 部电影、60K 条预告片、390 万张图片、375K 条电影元数据及字幕 / 剧本等文本）、丰富标注（覆盖 110 万角色边界框与 ID、42K 个场景分割、45K 个动作标签等）、多任务支持（从低到高级的视觉与语言任务）及开源工具库（数据爬取、预处理、特征提取等工具）；

基础数据（标注、元数据、关键帧等）可通过 OpenDataLab 下载，电影因版权限制需等待香港中文大学法律团队审批后发布，同时配套详细教程与文档，并支撑了多项发表于 ECCV、CVPR 等顶会的电影理解研究。

2. 思维导图（mindmap）

3. 详细总结

一、核心定位与发布信息

发布时间：2020 年 7 月 1 日
核心定位：面向电影理解的综合数据集（A holistic dataset for movie understanding），旨在支持从低级别到高级别的视觉与语言任务研究
主导团队：Qingqiu Huang（黄青虬）、Yu Xiong（熊宇）、Anyi Rao（饶安逸）等，关联香港中文大学（CUHK），相关成果发表于 ECCV、CVPR、ICCV 等顶会

核心优势类别	核心特点	关键内容
海量数据（Massive Data）	数据规模大、多模态，均免费开放	1.1K 部电影、60K 条预告片、375K 条元数据；含照片、字幕、剧本等多类型数据
丰富标注（Rich Annotation）	覆盖多维度，提供手动精准标注	演员（1.1M 实例边界框 + ID）、场景（42K 边界）、电影风格（镜头尺度 / 运动）、动作 & 场景标签
多样任务（Diverse Tasks）	支持低到高级，跨视觉与语言领域	低级别（检测 / 识别）、中级别（场景分割 / 风格预测）、高级别（梗概关联 / 片段检索）
开源工具库（Opensource Toolbox）	易用性强，覆盖全流程需求	含数据爬取、音视频预处理、特征提取工具（如 movienet-tools），支持本地 / 远程部署

二、核心数据构成（含关键统计）

数据类型	数量 / 规模	关键细节
电影（Movie）	1100 部	覆盖多年份、国家（如美国、中国、法国等）、类型（动作、喜剧、剧情等），支持多任务验证
预告片（Trailer）	60K 条（来自 33K 部独特电影）	提供 URL 链接，统计显示时长集中在 0-270 秒，镜头数集中在 0-150 个
图片（Photo）	3.9M 张	分 7 类：宣传照（46%）、静帧（36%）、活动照（9%）、海报（4%）等，提供原始与处理后数据
文本（Text）	3 类	字幕（815 个文件）、剧情梗概（Synopsis）、剧本（479 个文件，来自 1100 部电影中的部分）
元数据（Meta Data）	375K 条（JSON 格式）	含电影 IMDb/TMDB/ 豆瓣 ID、评分、导演、演员（含角色名）、剧情简介等，如《泰坦尼克号》元数据含 59 + 演员信息

三、丰富的标注内容（关键标注数据）

角色边界框与 ID（Character BBox & ID）：标注 110 万（1.1M）个角色实例，覆盖 3087 个署名演员，为角色检测与识别提供基础。
场景分割（Scene Segmentation）：标注 42K 个场景的边界，支持场景分割算法研究，示例含《Flight (2012)》（132 个场景）、《Saving Mr. Banks (2013)》（182 个场景）。
动作与场景标签（Action & Place Tags）：标注 42K 个电影片段，含 45K 个动作标签（80 类动作，如 “eat”“kiss”“shoot gun”）和 19.6K 个场景标签（90 类场景，如 “inside car”“airport”“pier”）。
镜头电影风格（Shot Cinematic Style）：
- 镜头尺度（5 类）：极特写（如眼睛）、特写（如面部）、中景（如膝盖以上）、全景（完整人物）、远景（人物占比小）；
- 镜头运动（4 类）：静态（相机固定）、摇移（相机旋转）、拉远（Zoom Out）、拉近（Zoom In）。
电影 - 梗概关联（Movie & Synopsis）：手动关联电影片段与剧情梗概段落，支持电影片段检索任务。

四、支持的任务与基准

涵盖多维度电影理解任务，包括但不限于：

低级别任务：角色检测与识别、镜头边界检测；

Detection & Identification

中级别任务：场景分割、场景标签预测、镜头风格（尺度 / 运动）预测；

Scene Segmentation

Scene Tag Prediction

Cinematic Style Prediction

高级别任务：电影片段 - 剧情梗概关联、基于标签的镜头检索、电影问答（Movie Q&A）。

Movie Synopsis Association

五、开源工具库（3 类核心工具）

项目地址：https://github.com/movienet

movienet-tools（https://github.com/movienet/movienet-tools）：
- 电影相关网站爬取（如 IMDb）；
- 音视频 / 图像预处理（如镜头检测器）；
- 多模态特征提取（如动作特征提取）。
movienet-core：
- MovieNet 数据与标注的核心解析器；
- 电影分析的 Python 扩展工具。
movienet-host：灵活的数据管理器，支持本地 / 远程部署 MovieNet 数据服务器。

六、数据下载指南

（1）基础下载（不含电影，需注册 OpenDataLab 账号）

下载内容	最后更新时间	压缩后大小	解压后大小	关键说明
标注（Annotation）	2020-02-08	53MB	881MB	含角色、场景、风格等所有标注
元数据（Meta）	2020-06-08	537MB	2.3GB	375K 条电影元数据
电影每镜头关键帧（240P）	2020-08-29	161GB	161GB	来自 1100 部电影
电影列表（1100 部）	2020-08-29	10KB	-	1100 部电影的基础信息
电影 1K 训练 / 验证 / 测试集	2020-08-29	30KB	-	任务训练划分
4M 海报图像元信息	2020-09-02	1.3GB	-	含海报 URL，需自行下载图像
字幕（815 个文件）	2020-09-05	29.9MB	84.4MB	来自 1100 部电影中的部分
剧本（479 个文件）	2020-09-05	27.9MB	101.8MB	来自 1100 部电影中的部分
镜头检测结果	2020-09-05	20.9MB	50.7MB	1100 部电影的镜头边界结果
音频特征	2020-09-06	89.7GB	-	1100 部电影的音频特征
场景特征	2020-09-06	11GB	-	1100 部电影的场景特征
电影视频信息（帧率等）	2020-09-09	118KB	-	含 fps、帧数量等
30K 预告片 URL	2020-10-17	2.155MB	-	30K 条预告片的访问链接

（2）电影下载（版权限制）

https://movienet.github.io/#!

因版权问题，电影需严格审批后发布；
目前已准备用户协议（经律师修订），待香港中文大学法律团队审批，开放时间待定。

（3）额外下载

特定 MovieNet 相关论文（如 CVPR 2018《Cast In Movies Dataset》）的数据，可从对应论文的项目页获取。

七、相关研究项目（顶会成果）

项目名称	发表会议	核心内容
MovieNet 数据集介绍	ECCV 2020（Spotlight）[1]	提出电影理解综合数据集，阐述数据构成与标注体系
电影风格分析	ECCV 2020	基于主体中心镜头的统一镜头类型分类框架
无监督人脸识别	ECCV 2020	基于字幕驱动的人脸识别，无需手动标注训练模型
在线多模态人物搜索	ECCV 2020	提出视频中在线多模态人物搜索方法，结合视觉与时间关联
电影场景时间分割	CVPR 2020	局部到全局的多模态电影场景分割方法，含迭代最优分组策略
电影 - 梗概关联（图框架）	ICCV 2019（Oral）	基于图结构的电影与剧情梗概关联方法，构建文本与视频的关联图谱
单肖像视频人物搜索	ECCV 2018	通过视觉与时间关联实现视频中基于单张肖像的人物搜索
人物识别（融合上下文）	CVPR 2018	统一人物识别与上下文学习，结合视觉与社交上下文
从预告片到剧情线	Arxiv 2018	基于预告片学习电影剧情线，支持标签检索、风格预测、电影问答

[1]: Holistic Movie Understanding Dataset

MovieNet: A Holistic Dataset for Movie Understanding

Qingqiu Huang*, Yu Xiong*, Anyi Rao, Jiaze Wang, Dahua Lin

European Conference on Computer Vision (ECCV), 2020 (Spotlight)

Paper Project Page Code Copy BibTeX to Clipboard

[2]: Movie Cinematic Style Analysis

A Unified Framework for Shot Type Classification Based on Subject Centric Lens

Anyi Rao, Jiaze Wang, Linning Xu, Xuekun Jiang, Qingqiu Huang, Bolei Zhou, Dahua Lin

European Conference on Computer Vision (ECCV), 2020

Paper Project Page Code Copy BibTeX to Clipboard

[3]: Unsupervised Face Recognition

Caption-Supervised Face Recognition: Training a State-of-the-Art Face Model without Manual Annotation

Qingqiu Huang, Lei Yang, Huaiyi Huang, Tong Wu, Dahua Lin

European Conference on Computer Vision (ECCV), 2020

Paper Project Page Code Copy BibTeX to Clipboard

[4]: Online Person Search

Online Multi-modal Person Search in Videos

Jiangyue Xia, Anyi Rao, Qingqiu Huang, Linning Xu, Jiangtao Wen, Dahua Lin

European Conference on Computer Vision (ECCV), 2020

Paper Project Page Code Copy BibTeX to Clipboard

[5]: Movie Scene Temporal Segmentation

A Local-to-Global Approach to Multi-modal Movie Scene Segmentation

Anyi Rao, Linning Xu, Yu Xiong, Guodong Xu, Qingqiu Huang, Bolei Zhou, Dahua Lin

Computer Vision and Pattern Recognition (CVPR), 2020

Also appear at LUV 2020 Workshop (15-min talk) and Sight and Sound 2020 Workshop (5-min talk)

Paper Project Page Code Copy BibTeX to Clipboard

[6]: Movie Synopsis Association

A Graph-based Framework to Bridge Movies and Synopses

Yu Xiong, Qingqiu Huang, Lingfeng Guo, Hang Zhou, Bolei Zhou, Dahua Lin

International Conference in Computer Vision (ICCV), 2019 (Oral)

Paper Project Page Code Copy BibTeX to Clipboard

[7]: Person Search

Person Search in Videos with One Portrait Through Visual and Temporal Links

Qingqiu Huang, Wentao Liu, Dahua Lin

European Conference on Computer Vision (ECCV), 2018

Paper Project Page Code Copy BibTeX to Clipboard

[8]: Person Recognition

Unifying Identification and Context Learning for Person Recognition

Qingqiu Huang, Yu Xiong, Dahua Lin

Computer Vision and Pattern Recognition (CVPR), 2018

Paper Project Page Copy BibTeX to Clipboard

[9]: Trailer Analysis

From Trailers to Storylines: An Efficient Way to Learn from Movies

Qingqiu Huang, Yuanjun Xiong, Yu Xiong, Yuqi Zhang, Dahua Lin

Arxiv:1806.05341, 2018

Paper Copy BibTeX to Clipboard

八、示例与统计

电影示例：以《泰坦尼克号》为例，提供完整元数据、字幕（如 “你跳，我也跳” 片段字幕）、剧本（第 63-66 场戏）、预告片（3 个不同版本）及 “飞行” 片段视频；
统计分布：
- 电影：年份覆盖多区间，国家以美国为主（log 尺度下数量最高），类型含动作、喜剧、剧情等；
- 预告片：时长集中在 0-270 秒，镜头数集中在 0-150 个；
- 图片：宣传照占比最高（46%），静帧次之（36%）。

1. Example of movies in MovieNet

Example Video

Example clip "flying" from movie Titanic.

（注：我没打开）

http://movie.mmlab.site/src/movienet/data_movie_titanic_clip_flying.mp4

Statistics

We show the distribution of release year, countries and genres for the 1, 100 movies in MovieNet (y-axis of country and genre in log scale).

2. Example of trailers in MovieNet

Example Video

Here we show three different trailers from movie Titanic.

https://movienet.github.io/src/imgs/examples/titanic_trailer_04.mp4

titanic_trailer_04

https://movienet.github.io/src/imgs/examples/titanic_trailer_02.mp4

titanic_trailer_02

https://movienet.github.io/src/imgs/examples/titanic_trailer_03.mp4

titanic_trailer_03

Statistics

The distribution of durations are shown below:

3. Examples and statistics of photots in MovieNet

Statistics

There are 7 types of photos in MovieNet, namely, publicity, still frame, event, poster, behind scene, product, production art. The statistics of these photos are shown below:

4. Example Photo

Here we show samples for different types of photos in MovieNet.

https://img-home.csdnimg.cn/images/20230724024159.png?origin_url=https%3A%2F%2Fmovienet.github.io%2Fsrc%2Fimgs%2Fexamples%2Fsample_photo.png&pos_id=BKL7MeIn

5. Examples of script, scynopsis and subtitle in MovieNet

Example

Here we show the fast forward clip of "you jump, I jump" and the related subtilte, synopses and script. The highlighted color is the corresponding text content of the clip.

jump_010203

https://movienet.github.io/src/imgs/examples/jump_010203.mp4

subtitle synopsis script

    38000:34:05,282 --> 00:34:06,601I'm Tommy Ryan.38100:34:06,682 --> 00:34:08,081- Jack Dawson.- Hello.38200:34:08,162 --> 00:34:09,641- Fabrizio.- Hi.38300:34:10,562 --> 00:34:13,076Do you make any moneywith your drawings?...39500:37:02,877 --> 00:37:04,196Don't do it.39600:37:04,677 --> 00:37:05,951Stay back.39700:37:06,917 --> 00:37:08,669Don't come any closer.39800:37:09,517 --> 00:37:12,030Come on. Just give me your hand,I'll pull you back over.39900:37:12,117 --> 00:37:13,947No! Stay where you are.40000:37:14,476 --> 00:37:15,796I mean it.40100:37:16,356 --> 00:37:17,675I'll let go.40200:37:28,476 --> 00:37:29,909No, you won't....41100:37:55,035 --> 00:37:56,866The fall alone will kill you.41200:37:56,955 --> 00:37:59,594It would hurt.I'm not saying it wouldn't.41300:38:00,195 --> 00:38:02,186To tell you the truth,I'm a lot more concerned ...41400:38:02,275 --> 00:38:04,345about that water being so cold....45200:40:30,030 --> 00:40:31,429Help, please!45300:40:34,270 --> 00:40:37,307- Please, help me!- Listen to me. I've got you.45400:40:37,590 --> 00:40:39,069I won't let go.45500:40:39,150 --> 00:40:41,266Now pull yourself up. Come on!45600:40:43,990 --> 00:40:45,787Come on. That's right.45700:40:46,430 --> 00:40:47,863You can do it.45800:40:52,190 --> 00:40:53,509I got you.45900:40:58,909 --> 00:41:00,467What's all this?46000:41:05,869 --> 00:41:08,463You stand back!And don't move an inch!46100:41:10,789 --> 00:41:12,268Fetch the master-at-arms.46200:41:14,269 --> 00:41:16,499This is completely unacceptable.46300:41:16,789 --> 00:41:20,304What made you think you couldput your hands on my fiancée?46400:41:20,669 --> 00:41:22,261Look at me, you filth!46500:41:22,349 --> 00:41:24,385- Cal.- What do you think you were doing?46600:41:24,469 --> 00:41:26,584Cal, stop. It was an accident.46700:41:27,708 --> 00:41:29,061An accident?46800:41:29,708 --> 00:41:30,858It was.46900:41:32,028 --> 00:41:33,427Stupid, really.

In 1996, treasure hunter Brock Lovett (Bill Paxton) and his team aboard the research vessel Keldysh search the wreck of RMS Titanic for a necklace with a rare diamond, the Heart of the Ocean. They recover a safe containing a drawing of a young woman wearing only the necklace. It is dated April 14, 1912, the day the ship struck the iceberg. Rose Dawson Calvert (Gloria Stuart), claiming to be the person in the drawing, visits Lovett and tells of her experiences aboard the ship.In 1912 Southampton, 17-year-old first-class passenger Rose DeWitt Bukater (Kate Winslet), her fiancé Cal Hockley (Billy Zane), and her mother Ruth (Frances Fisher) board the Titanic. Also boarding the ship at Southampton are Jack Dawson (Leonardo DiCaprio), a down-on-his-luck sketch artist, and his Italian friend Fabrizio (Danny Nucci). Young Rose, angry and distraught that her mother has apparently arranged the marriage, considers committing suicide by jumping from the stern; Jack manages to pull her back over the rail after she loses her footing & nearly falls into the propellers. Discovered with Jack, Rose tells Cal that she was peering over the edge and Jack saved her from falling. Cal is indifferent, but when Rose indicates some recognition is due, he offers Jack a small amount of money.After Rose asks whether saving her life meant so little, he invites Jack to dine with them in first class the following night, along with several prominent first-class passengers - including the Countess of Rothes, Archibald Gracie (Bernard Fox), Thomas Andrews (Victor Garber), Molly Brown (Kathy Bates), and John Jacob Astor (Eric Braeden) & his wife. Jack and Rose develop a tentative friendship, though Cal and Ruth are wary of him.Following dinner, Rose secretly joins Jack at a party in third class. During the party Cal's butler, Spicer Lovejoy (David Warner) stealthily sneaks down the third class staircase to spy on her. After a very tense breakfast the following morning, in which Cal shows an inclination towards violence, Rose becomes even more apprehensive about her upcoming marriage. Ruth emphasizes that Rose's marriage will resolve the DeWitt Bukaters' financial problems. After spotting Rose, Cal and Ruth out on the Boat Deck, Jack stealthily sneaks back into First Class and tries to warn Rose about what she may be facing. Rose rebuffs Jack's advances, but later realizes that she prefers him over Cal.After meeting on the bow at sunset, Rose takes Jack to her state room and displays Cal's engagement present: the Heart of the Ocean. At her request, Jack sketches Rose posing nude wearing it. Meanwhile, in the First-Class Smoking Room, Cal's butler informs him that none of the stewards have seen Rose at all that night. Cal orders the butler to find her. Rose & Jack manage to evade Cal's bodyguard and have sex in an automobile inside the cargo hold. They later visit the forward well deck, and while on it, the lookouts spot an iceberg directly in the ship's path.Orders are given to turn the ship hard a-starboard and run the engines full astern, but the ship takes too long to make the turn and the starboard side scrapes along the iceberg, causing substantial damage to the watertight compartments, including the cargo hold where Jack & Rose had been having sex in the automobile. Jack & Rose witness the collision with the iceberg and overhear the officers and designer discussing its seriousness.On the bridge, builder Thomas Andrews, Captain Smith (Bernard Hill), the ship's officers and White Star Line Managing Director Bruce Ismay (Jonathan Hyde) discuss the damage. The water has reached 14 feet above the keel in 10 minutes and has flooded 5 watertight compartments. Mr. Andrews warns that because of a design flaw, the water will spill over the tops of the bulkheads at E Deck, and this will cause the ship to sink. He gives an hour, two at most, for the ship to remain afloat.Cal discovers Jack's sketch of Rose and a mocking note from her in his safe along with the necklace. When Jack and Rose attempt to tell Cal of the collision, he has his butler slip the necklace into Jack's pocket and accuses him of theft. He is arrested, taken to the Master-at-arms' office, and handcuffed to a pipe.Cal puts the necklace in his own coat pocket. With the ship sinking, Rose is desperate to free Jack. She flees Cal and her mother, who has boarded a lifeboat, and rescues him. They return to the boat deck, where Cal and Jack encourage her to board a lifeboat; Cal claims he can get himself and Jack off safely. After Rose boards one, Cal tells Jack the arrangement is only for himself.As her boat lowers, Rose decides that she cannot leave Jack and jumps back on board. Jack confronts her, angrily at first, but his angers soon turns to affection and they share a series of kisses at the bottom of the Grand Staircase. Cal, seeing this, takes his butler's pistol and chases Rose and Jack into the flooding first class dining saloon. After using up his ammunition, Cal realizes he gave his coat and consequently the necklace to Rose.Jack & Rose are forced to flee below decks to escape Cal, and narrowly escape drowning themselves. They become trapped behind a locked gate, but Jack manages to free them just as the rising water reaches their heads. Out on the Boat Deck, Cal decides to make his own escape. He reminds the First Officer of the arrangement made earlier, but the officer angrily turns on Cal and refuses to allow him boarding. When he spots a lost child hiding behind a winch, he takes the child and is subsequently allowed into a collapsible lifeboat by Chief Officer Wilde.As Cal and others board the collapsible, the water surges into the bridge & wheelhouse, drowning Captain E.J. Smith and causing Cal's boat to start floating off the deck. By now the stern is staring to rise out of the water and the remaining passengers are running farther & farther aft. After braving several obstacles, Jack and Rose return to the boat deck.All the lifeboats have departed and passengers are falling to their deaths as the stern rises out of the water. Water now crashes through the huge dome over the Grand Staircase, drowning those passengers trapped inside. Jack & Rose reach the very stern - where they had first met - and take up positions on it by climbing over the rail, next to Chief Baker Charles Joughin.The ship breaks in half, causing the stern to crash down into the water and killing Lovejoy, the butler. As the bow breaks off it pulls the stern back into the air, leaving it sitting there for a minute. Jack and Rose ride it into the ocean as it fills with water and then plunges to the bottom.As Jack & Rose let go of the stern, the Titanic disappears into the darkness below them, and they both swim to the surface to find themselves in a massive mob of passengers and crew. Within minutes, Rose & Jack find a piece of paneling from the Grand Staircase, and he helps her onto the wooden panel only buoyant enough for one person. Holding the edge, he assures her that she will die an old woman, warm in her bed. He dies of hypothermia but she is saved when Fifth Officer Lowe & some crewmen return to try to find survivors.With Rose hiding from Cal en route, the RMS Carpathia takes the survivors to New York. There she gives her name as Rose Dawson. She later learns that Cal committed suicide after losing everything in the 1929 Wall Street Crash.Lovett abandons his search after hearing Rose's story. Alone on the stern of the Keldysh, Rose takes out the Heart of the Ocean - in her possession all along - and drops it into the sea over the wreck site. While she is seemingly asleep in her bed, photos on her dresser depict a life of freedom and adventure, partly inspired by Jack. A young Rose returns to the ship - at first, a gloomy wreck on the bottom - but as Rose reaches the Promenade Deck the ship begins to glow with light. As she enters the Grand Staircase she is greeted by those who perished on the ship - including the Titanic's band, First Officer Murdoch, Thomas Andrews, Jack's friends Fabrizio & Tommy Ryan, and standing at the clock is Jack himself. He extends a hand and they reunite, to the happy cheers of the perished passengers & crew.

...63 INT. ROSE'S BEDROOM - NIGHTShe enters the room. Stands in the middle, staring at her reflection in thelarge vanity mirror. Just stands there, then--With a primal, anguished cry she claws at her throat, ripping off her pearlnecklace, which explodes across the room. In a frenzy she tears at herself,her clothes, her hair... then attacks the room. She flings everything offthe dresser and it flies clattering against the wall. She hurls ahandmirror against the vanity, cracking it.CUT TO:64 EXT. A DECK PROMENADE, AFT - NIGHTRose runs along the B deck promenade. She is dishevelled, her hair flying.She is crying, her cheeks streaked with tears. But also angry, furious!Shaking with emotions she doesn't understand... hatred, self-hatred,desperation. A strolling couple watch her pass. Shocked at the emotionaldisplay in public.CUT TO:65 EXT. POOP DECK - NIGHTJack is kicked back on one of the benches gazing at the stars blazinggloriously overhead. Thinking artist thoughts and smoking a cigarette.Hearing something, he turns as Rose runs up the stairs from the well deck.They are the only two on the stern deck, except for QUARTERMASTER ROWE,twenty feet above them on the docking bridge catwalk. She doesn't see Jackin the shadows, and runs right past him.TRACKING WITH ROSE as she runs across the deserted fantail. Her breathhitches in an occasional sob, which she suppresses. Rose slams against thebase of the stern flagpole and clings there, panting. She stares out at theblack water.Then starts to climb over the railing. She has to hitch her long dress wayup, and climbing is clumsy. Moving methodically she turns her body and getsher heels on the white-painted gunwale, her back to the railing, facing outtoward blackness. 60 feet below her, the massive propellers are churningthe atlantin into white foam, and a ghostly wake trails off toward thehorizon.IN A LOW ANGLE, we see Rose standing like a figurehead in reverse. Belowher are the huge letters of the name "TITANIC".She leans out, her arms straightening... looking down hypnotized, into thevortex below her. Her dress and hair are lifted by the wind of the ship'smovement. The only sound, above the rush of water below, is the flutter andsnap of the big Union Jack right above her.JACKDon't do it.She whips her head around at the sound of his voice. It takes a second forher eyes to focus.ROSEStay back! Don't come any closer!Jack sees the tear tracks on her cheeks in the faint glow from the sternrunning lights.JACKTake my hand. I'll pull you back in.ROSENo! Stay where you are. I mean it. I'll let go.JACKNo you won't.ROSEWhat do you mean no I won't? Don't presume to tell me what I will and willnot do. You don't know me.JACKYou would have done it already. Now come on, take my hand.Rose is confused now. She can't see him very well through the tears, so shewipes them with one hand, almost losing her balance.ROSEYou're distracting me. Go away.JACKI can't. I'm involved now. If you let go I have to jump in after you.ROSEDon't be absurd. You'll be killed.He takes off his jacket.JACKI'm a good swimmer.He starts unlacing his left shoe.ROSEThe fall alone would kill you.JACKIt would hurt. I'm not saying it wouldn't. To be honest I'm a lot moreconcerned about the water being so cold.She looks down. The reality factor of what she is doing is sinking in.ROSEHow cold?JACK(taking off his left shoe)Freezing. Maybe a couple degrees over.He starts unlacing his right shoe.JACKEver been to Wisconsin?ROSE(perplexed)No.JACKWell they have some of the coldest winters around, and I grew up there,near Chippewa Falls. Once when I was a kid me and my father wereice-fishing out on Lake Wissota... ice-fishing's where you chop a hole inthe--ROSEI know what ice fishing is!JACKSorry. Just... you look like kind of an indoor girl. Anyway, I went throughsome thin ice and I'm tellin' ya, water that cold... like that right downthere... it hits you like a thousand knives all over your body. You can'tbreath, you can't think... least not about anything but the pain.(takes off his other shoe)Which is why I'm not looking forward to jumping in after you. But like Isaid, I don't see a choice. I guess I'm kinda hoping you'll come back overthe rail and get me off the hook here.ROSEYou're crazy.JACKThat's what everybody says. But with all due respect, I'm not the onehanging off the back of a ship.He slides one step closer, like moving up on a spooked horse.JACKCome on. You don't want to do this. Give me your hand.Rose stares at this madman for a long time. She looks at his eyes and theysomehow suddenly seem to fill her universe.ROSEAlright.She unfastens one hand from the rail and reaches it around toward him. Hereaches out to take it, firmly.JACKI'm Jack Dawson.ROSE(voice quavering)Pleased to meet you, Mr. Dawson.Rose starts to turn. Now that she has decided to live, the height isterrifying. She is overcome by vertigo as she shifts her footing, turningto face the ship. As she starts to climb, her dress gets in the way, andone foot slips off the edge of the deck.She plunges, letting out a piercing SHRIEK. Jack, gripping her hand, isjerked toward the rail. Rose barely grabs a lower rail with her free hand.QUARTERMASTER ROWE, up on the docking bridge hears the scream and heads forthe ladder.ROSEHELP! HELP!!JACKI've got you. I won't let go.Jack holds her hand with all his strength, bracing himself on the railingwith his other hand. Rose tries to get some kind of foothold on the smoothhull. Jack tries to lift her bodily over the railing. She can't get anyfooting in her dress and evening shoes, and she slips back. Rose SCREAMSagain.Jack, awkwardly clutching Rose by whatever he can get a grip on as sheflails, gets her over the railing. They fall together onto the deck in atangled heap, spinning in such a way that Jack winds up slightly on top ofher.Rowe slides down the ladder from the docking bridge like it's a fire drilland sprints across the fantail.ROWEHere, what's all this?!Rowe runs up and pulls Jack off of Rose, revealing her dishevelled andsobbing on the deck. Her dress is torn, and the hem is pushing up above herknees, showing one ripped stocking. He looks at Jack, the shaggy steerageman with his jacket off, and the first class lady clearly in distress, andstarts drawing conclusions. Two seamen chug across the deck to join them.ROWE(to Jack)Here you, stand back! Don't move an inch!(to the seamen)Fetch the Master at Arms.CUT TO:66 EXT. POOP DECK - NIGHTA few minutes later. Jack is being detained by the burly MASTER AT ARMS,the closest thing to a cop on board. He is handcuffing Jack. Cal is rightin front of Jack, and furious. He has obviously just rushed out here withLovejoy and another man, and none of them have coats over their black tieevening dress. The other man is COLONEL ARCHIBALD GRACIE, a mustachioedblowhard who still has his brandy snifter. He offers it to Rose, who ishunched over crying on a bench nearby, but she waves it away. Cal is moreconcerned with Jack. He grabs him by the lapels.CALWhat made you think you could put your hands on my fiancee?! Look at me,you filth! What did you think you were doing?!ROSECal, stop! It was an accident.CALAn accident?!ROSEIt was... stupid really. I was leaning over and I slipped.Rose looks at Jack, getting eye contact.ROSEI was leaning way over, to see the... ah... propellers. And I slipped and Iwould have gone overboard... and Mr. Dawson here saved me and he almostwent over himself.CALYou wanted to see the propellers?...

6. Examples of meta data in MovieNet

Example Meta Data

Here we show meta data of movie Titanic.

{"imdb_id": "tt0120338","tmdb_id": "597","douban_id": "1292722","title": "Titanic (1997)","genres": ["Drama","Romance"],"country": "USA","version": [{"runtime": "194 min","description": ""}],"imdb_rating": 7.7,"director": [{"id": "nm0000116","name": "James Cameron"}],"writer": [{"id": "nm0000116","name": "James Cameron","description": "written by"}],"cast": [{"id": "nm0000138","name": "Leonardo DiCaprio","character": "Jack Dawson"},{"id": "nm0000701","name": "Kate Winslet","character": "Rose Dewitt Bukater"},{"id": "nm0000708","name": "Billy Zane","character": "Cal Hockley"},{"id": "nm0000870","name": "Kathy Bates","character": "Molly Brown"},{"id": "nm0004920","name": "Frances Fisher","character": "Ruth Dewitt Bukater"},{"id": "nm0001784","name": "Gloria Stuart","character": "Old Rose"},{"id": "nm0000200","name": "Bill Paxton","character": "Brock Lovett"},{"id": "nm0384060","name": "Bernard Hill","character": "Captain Smith"},{"id": "nm0001831","name": "David Warner","character": "Spicer Lovejoy"},{"id": "nm0001255","name": "Victor Garber","character": "Thomas Andrews"},{"id": "nm0404993","name": "Jonathan Hyde","character": "Bruce Ismay"},{"id": "nm0000751","name": "Suzy Amis","character": "Lizzy Calvert"},{"id": "nm0008656","name": "Lewis Abernathy","character": "Lewis Bodine"},{"id": "nm0143167","name": "Nicholas Cascone","character": "Bobby Buell"},{"id": "nm0755972","name": "Anatoly M. Sagalevitch","character": "Anatoly Milkailavich"},{"id": "nm0001572","name": "Danny Nucci","character": "Fabrizio"},{"id": "nm0058029","name": "Jason Barry","character": "Tommy Ryan"},{"id": "nm0829380","name": "Ewan Stewart","character": "1st Officer Murdoch"},{"id": "nm0344435","name": "Ioan Gruffudd","character": "Fifth Officer Lowe"},{"id": "nm0680526","name": "Jonny Phillips","character": "2nd Officer Lightoller"},{"id": "nm0152464","name": "Mark Lindsay Chapman","character": "Chief Officer Wilde"},{"id": "nm0334262","name": "Richard Graham","character": "Quartermaster Rowe"},{"id": "nm0109229","name": "Paul Brightwell","character": "Quartermaster Hichens"},{"id": "nm0231871","name": "Ron Donachie","character": "Master at Arms"},{"id": "nm0000967","name": "Eric Braeden","character": "John Jacob Astor"},{"id": "nm0154195","name": "Charlotte Chatton","character": "Madeleine Astor"},{"id": "nm0288882","name": "Bernard Fox","character": "Col. Archibald Gracie"},{"id": "nm0258117","name": "Michael Ensign","character": "Benjamin Guggenheim"},{"id": "nm0107938","name": "Fannie Brett","character": "Madame Aubert"},{"id": "nm0001280","name": "Jenette Goldstein","character": "Irish Mommy"},{"id": "nm0653829","name": "Camilla Overbye Roos","character": "Helga Dahl"},{"id": "nm0449599","name": "Linda Kerns","character": "3rd Class Woman"},{"id": "nm0301401","name": "Amy Gaipa","character": "Trudy Bolt"},{"id": "nm0419089","name": "Martin Jarvis","character": "Sir Duff Gordon"},{"id": "nm0044011","name": "Rosalind Ayres","character": "Lady Duff Gordon"},{"id": "nm0741645","name": "Rochelle Rose","character": "Countess of Rothes"},{"id": "nm0263323","name": "Jonathan Evans-Jones","character": "Wallace Hartley"},{"id": "nm0909574","name": "Brian Walsh","character": "Irish Man"},{"id": "nm0853092","name": "Rocky Taylor","character": "Bert Cartmell"},{"id": "nm0654302","name": "Alexandrea Owens","character": "Cora Cartmell"},{"id": "nm0186426","name": "Simon Crane","character": "4th Officer Boxhall"},{"id": "nm0281992","name": "Edward Fletcher","character": "6th Officer Moody"},{"id": "nm0027424","name": "Scott Anderson","character": "Frederick Fleet"},{"id": "nm0247542","name": "Martin East","character": "Lookout Lee"},{"id": "nm0446287","name": "Craig Kelly","character": "Harold Bride"},{"id": "nm0177427","name": "Gregory Cooke","character": "Jack Phillips"},{"id": "nm0876720","name": "Liam Tuohy","character": "Chief Baker Joughin"},{"id": "nm0484140","name": "James Lancaster","character": "Father Byles"},{"id": "nm0712341","name": "Elsa Raven","character": "Ida Straus"},{"id": "nm0658817","name": "Lew Palter","character": "Isidor Straus"},{"id": "nm0859809","name": "Reece P. Thompson III","character": "Irish Little Boy"},{"id": "nm0484837","name": "Laramie Landis","character": "Irish Little Grl"},{"id": "nm0905290","name": "Amber Waddell","character": "Cal's Crying Girl"},{"id": "nm0905289","name": "Alison Waddell","character": "Cal's Crying Girl"},{"id": "nm0874171","name": "Mark Rafael Truitt","character": "Yaley"},{"id": "nm0906975","name": "John Walcutt","character": "1st Class Husband"},{"id": "nm0286157","name": "Terry Forrestal","character": "Chief Engineer Bell"},{"id": "nm0494749","name": "Derek Lea","character": "Leading Stoker Barrett"},{"id": "nm0039263","name": "Richard Ashton","character": "Carpenter John Hutchinson"},{"id": "nm0626119","name": "Sean Nepita","character": "Elevator Operator       (as Sean M. Nepita)"},{"id": "nm0175267","name": "Brendan Connolly","character": "Scotland Road Steward"},{"id": "nm0188836","name": "David Cronnelly","character": "Crewman"},{"id": "nm0934350","name": "Garth Wilton","character": "1st Class Waiter"},{"id": "nm0481918","name": "Martin Laing","character": "Promenade Deck Steward"},{"id": "nm0289211","name": "Richard Fox","character": "Steward #1"},{"id": "nm0575164","name": "Nick Meaney","character": "Steward #2"},{"id": "nm0654503","name": "Kevin Owers","character": "Steward #3"},{"id": "nm0135633","name": "Mark Capri","character": "Steward #4"},{"id": "nm0006976","name": "Marc Cass","character": "Hold Steward #1"},{"id": "nm0378609","name": "Paul Herbert","character": "Hold Steward #2"},{"id": "nm0416474","name": "Emmett James","character": "1st Class Steward"},{"id": "nm0126137","name": "Chris Byrne","character": "Stairwell Steward       (as Christopher Byrne)"},{"id": "nm0656297","name": "Oliver Page","character": "Steward Barnes"},{"id": "nm0308127","name": "James Garrett","character": "Titanic Porter"},{"id": "nm0390683","name": "Erik Holland","character": "Olaf Dahl"},{"id": "nm0455801","name": "Jari Kinnunen","character": "Bjorn Gunderson"},{"id": "nm0266119","name": "Anders Falk","character": "Olaus Gunderson"},{"id": "nm0399103","name": "Martin Hub","character": "Slovakian Father"},{"id": "nm0012079","name": "Seth Adkins","character": "Slovakian 3 Year Old Boy"},{"id": "nm0219336","name": "Barry Dennen","character": "Praying Man"},{"id": "nm0881951","name": "Vern Urich","character": "Man in Water"},{"id": "nm0459779","name": "Rebecca Klingler","character": "Mother at Stern       (as Rebecca Jane Klingler)"},{"id": "nm0642078","name": "Tricia O'Neil","character": "Woman"},{"id": "nm0242649","name": "Kathleen S. Dunn","character": "Woman in Water       (as Kathleen Dunn)"},{"id": "nm0290302","name": "Romeo Francis","character": "Syrian Man"},{"id": "nm0547808","name": "Mandana Marino","character": "Syrian Woman"},{"id": "nm0512746","name": "Van Ling","character": "Chinese Man"},{"id": "nm0647600","name": "Bj\u00f8rn Olsen","character": "Olaf       (as Bj\u00f8rn)"},{"id": "nm0678562","name": "Dan Pettersson","character": "Sven"},{"id": "nm0240474","name": "Shay Duffin","character": "Pubkeeper"},{"id": "nm0254862","name": "Greg Ellis","character": "Carpathia Steward"},{"id": "nm0604611","name": "Diana Morgan","character": "News Reporter"},{"id": "nm9200859","name": "Salonisti","character": "Titanic Orchestra       (as I Salonisti)"},{"id": "nm9200860","name": "Gaelic Storm","character": "Steerage Band"},{"id": "nm0027735","name": "Kris Andersson","character": "Dancer"},{"id": "nm0060858","name": "Bobbie Bates","character": "Dancer"},{"id": "nm0143568","name": "Aaron James Cash","character": "Dancer"},{"id": "nm0281945","name": "Anne Fletcher","character": "Dancer"},{"id": "nm0287038","name": "Edmond Alan Forsyth","character": "Dancer       (as Ed Forsyth)"},{"id": "nm0382794","name": "Andie Hicks","character": "Dancer"},{"id": "nm0386816","name": "Scott Hislop","character": "Dancer"},{"id": "nm0563306","name": "Stan Mazin","character": "Dancer"},{"id": "nm0711938","name": "Lisa Ratzin","character": "Dancer"},{"id": "nm0719444","name": "Julene Renee","character": "Dancer"},{"id": "nm0368229","name": "Lorenz Hasler","character": "I Salonisti Violin"},{"id": "nm0299809","name": "Thomas F\u00fcri","character": "I Salonisti Violin"},{"id": "nm0843876","name": "Ferenc Szedl\u00e1k","character": "I Salonisti Cello"},{"id": "nm0843875","name": "B\u00e9la Szedl\u00e1k","character": "I Salonisti Double Bass"},{"id": "nm0317594","name": "Werner Giger","character": "I Salonisti Piano"},{"id": "nm0125320","name": "Mike Butters","character": "Musician"},{"id": "nm0000116","name": "James Cameron","character": "Steerage Dancer"}],"overview": "84 years later, a 101-year-old woman named Rose DeWitt Bukater 
tells the story to her granddaughter Lizzy Calvert, Brock Lovett, ... And she 
explains the whole story from departure until the death of Titanic on its first 
and last voyage April 15th, 1912 at 2:20 in the morning.","storyline": "84 years later, a 100 year-old woman named Rose DeWitt Bukater
tells the story to her granddaughter Lizzy Calvert, Brock Lovett, ... And she 
explains the whole story from departure until the death of Titanic on its first 
and last voyage April 15th, 1912 at 2:20 in the morning.","plot": "In 1996, treasure hunter Brock Lovett and his team aboard the 
research vessel Akademik Mstislav Keldysh search the wreck of RMS Titanic for a 
necklace with a rare diamond, the Heart of the Ocean. ... A young Rose reunites 
with Jack at the Titanic's Grand Staircase, applauded by those who died.","synopsis": "In 1996, treasure hunter Brock Lovett (Bill Paxton) and his 
team aboard the research vessel Keldysh search the wreck of RMS Titanic for a 
necklace with a rare diamond, the Heart of the Ocean. ...e extends a hand and 
they reunite, to the happy cheers of the perished passengers & crew."}

7. Examples and statistics of photots in MovieNet

Example Photo

Here we show samples for different types of photos in MovieNet.

8. Example shot cinematic style annotation

Shot Scale Annotation

Shot scale depict the portion of subject within the frames in a shot. Shot scale has 5 categories:
1. Extreme close-up shot: it only shows a very small part of a subject, e.g., an eye or a mouth of a person;
2. Close-up shot: it concentrates on a relatively small part of a subject, e.g., the face of the hand of a person;
3. Medium shot: it contains part of a subject e.g., a figure from the knees or waist up;
4. Full shot: it includes the full subject;
5. Long shot: it is taken from a long distance and the subject is very small within the frames.

Shot Movement

Shot movement describe the camera movement or the lens change of a shot. There are 4 categories of shot movement:
1. Static shot: the camera is fixed but the subject is flexible to move;
2. Pans and tilts shot: the camera moves or rotates;
3. Zoom out shot: the camera zooms out for pull shot;
4. Zoom in shot: the camera zooms in for push shot.

9. Example of movie synopsis association annotation

Example pair

Here we show an example pair of synopsis paragraph and movie segment under the scene of playing basketball. The video is fast-forwarded from original length 220s to 12s.

https://movienet.github.io/src/imgs/examples/basketball_12s.mp4

basketball_12s

Steven goes to the gym to play basketball with some friends, and Chip awkwardly shows up. Chip inserts himself into the game, and plays in a very aggressive manner, knocking down other players and eventually break the basketball board. Steven is obviously mad at Chip and walks off.

10. Example of scene segmentation annotation

Examples

Examples of the annotated scenes from two movies. The two lines in the middle correspond to the whole movie time line where the dark blue and light blue regions represent different annotated scenes, while the representative frames sampled from some scenes are also shown.