2020Q3 Reports: General Chair - Revision history

Jurafsky: /* Summary of what happened */

2020-07-27T18:41:35Z

Summary of what happened

← Older revision		Revision as of 18:41, 27 July 2020
Line 10:		Line 10:
	<li> ACL was the largest ever, with record number of submissions (3,429), accepted papers (778), and attendees (4,972).		<li> ACL was the largest ever, with record number of submissions (3,429), accepted papers (778), and attendees (4,972).
	<li>It was also the most diverse ACL ever!		<li>It was also the most diverse ACL ever!
	<li> We cut registration fees down sharply to $125 (regular) and $50 (students), and also significantly increased the grants for free registration for those in need, and paid registration for all organization committee members		<li> We cut registration fees down sharply to $125 (regular) and $50 (students), and also significantly increased the grants for free registration for those in need, and paid registration for all organization committee members and a very large number of volunteers.
	<li>Nonetheless, we had a healthy surplus. We should increase subsidies for those in need, and probably could decrease registration fees further (perhaps decrease fees significantly, and raise them for late registration, since late registrations were a large problem).		<li>Nonetheless, we had a healthy surplus. We should increase subsidies for those in need, and probably could decrease registration fees further (perhaps decrease fees significantly, and raise them for late registration, since late registrations were a large problem).
	<li> For our virtual infrastructure we chose to mostly follow the ICLR model,		<li> For our virtual infrastructure we chose to mostly follow the ICLR model,

Jurafsky: /* Summary of what happened */

2020-07-27T18:41:10Z

Summary of what happened

← Older revision		Revision as of 18:41, 27 July 2020
Line 10:		Line 10:
	<li> ACL was the largest ever, with record number of submissions (3,429), accepted papers (778), and attendees (4,972).		<li> ACL was the largest ever, with record number of submissions (3,429), accepted papers (778), and attendees (4,972).
	<li>It was also the most diverse ACL ever!		<li>It was also the most diverse ACL ever!
			<li> We cut registration fees down sharply to $125 (regular) and $50 (students), and also significantly increased the grants for free registration for those in need, and paid registration for all organization committee members
			<li>Nonetheless, we had a healthy surplus. We should increase subsidies for those in need, and probably could decrease registration fees further (perhaps decrease fees significantly, and raise them for late registration, since late registrations were a large problem).
	<li> For our virtual infrastructure we chose to mostly follow the ICLR model,		<li> For our virtual infrastructure we chose to mostly follow the ICLR model,
	with some modifications:		with some modifications:

Jurafsky: /* ACL 2020 post-conference report: General Chair */

2020-07-27T18:37:32Z

ACL 2020 post-conference report: General Chair

← Older revision		Revision as of 18:37, 27 July 2020
Line 39:		Line 39:
	<li>People in China had to use VPNs to watch the pre-recorded talks.		<li>People in China had to use VPNs to watch the pre-recorded talks.
	<li>All the software (but especially SlidesLive, but also Zoom) had all sorts of problems.		<li>All the software (but especially SlidesLive, but also Zoom) had all sorts of problems.
	We probably don't want to reuse SlidesLive, but Zoom we may have no choice.		We probably don't want to reuse SlidesLive (although it's not obvious there's a better replacement), but Zoom we may have no choice.
	<li>Ethics and PCC stuff caused headaches that could have been avoided		<li>Ethics and PCC stuff caused headaches that could have been avoided
	with ethics statements as part of submissions and best paper awards.		with ethics statements as part of submissions and best paper awards.
Line 59:		Line 59:
	</ul>		</ul>

	=== Overview of suggestions future conferences ===		=== Overview of suggestions for future conferences ===

	==== Switching to Virtual: Advice on Personnel and Chairs ====		==== Switching to Virtual: Advice on Personnel and Chairs ====

Jurafsky: /* Summary of what happened */

2020-07-27T18:36:11Z

Summary of what happened

← Older revision		Revision as of 18:36, 27 July 2020
Line 6:		Line 6:
	==== Summary of what happened ====		==== Summary of what happened ====

	~~<b>Positive:</b>~~
	<ul>		<ul>
	<li>We ran a virtual ACL with only a few months notice, and it wasn't a disaster!		<li>We ran a virtual ACL with only a few months notice, and it wasn't a disaster!
	<li>~~Largest~~ ever ~~in every way~~ (~~including attendance~~)!		<li> ACL was the largest ever, with record number of submissions (3,429), accepted papers (778), and attendees (4,972).
	<li>~~Also~~ most diverse ACL ever!		<li>It was also the most diverse ACL ever!
			<li> For our virtual infrastructure we chose to mostly follow the ICLR model,
			with some modifications:
			<ul>
			<li> pre-recorded talks, recorded using the SlidesLive web-based tools, with ASR-based captions hand-corrected by authors.
			<li> a website dashboard based on the miniconf package, with a schedule page that can be adjusted to each timezone, a
			separate webpage for each paper that gives its pre-recorded video, paper, zoom channel, and Rocketchat link.
			<li> Livestreamed plenary sessions, also run by SlidesLive, with a mix of recorded talks and live presentations
			<li> Rocketchat sessions associated with each talk
			<li> Two 1-hour Zoom Q&A sessions for each of the talks.
			<li> Tutorials that were a mix of live sessions and pre-recorded talks
			<li> Workshops that also used a mix of live sessions and pre-recorded talks
			</ul>
			</ul>

			<b>Other Positive Results:</b>
			<ul>
	<li>The new tracks (Ethics, Interpretation, Taking Stock, etc) were		<li>The new tracks (Ethics, Interpretation, Taking Stock, etc) were
	very popular; they were the most watched talks (https://twitter.com/yoavgo/status/1282459579339681792)		very popular; they were the most watched talks (https://twitter.com/yoavgo/status/1282459579339681792)

Jurafsky: /* Switching to Virtual: Advice on Software Partners */

2020-07-23T20:05:09Z

Switching to Virtual: Advice on Software Partners

← Older revision		Revision as of 20:05, 23 July 2020
Line 79:		Line 79:
	<ul>		<ul>

	<li>While SlidesLive had many advantages, in the end our advice		<li>While using a video-presentation company like SlidesLive had many advantages, in the end our advice
	is that ACL should ~~strongly consider not using~~ SlidesLive going forward. They caused a number of problems:		is that ACL should try to find alternatives to SlidesLive going forward. They caused a number of problems:
	<ul>		<ul>
	<li>They initially gave us the impression they would handle creating all the zoom rooms for the conference, then changed their mind		<li>They initially gave us the impression they would handle creating all the zoom rooms for the conference, then changed their mind
Line 101:		Line 101:
	the LTA and in many other speakers, and was especially a problem in the workshops.		the LTA and in many other speakers, and was especially a problem in the workshops.
	</ul>		</ul>
	<li>However, we don't know if there are strong alternatives:		<li>However, it's possible that they will begin to improve as they grow as a company,
			and frankly we don't know if there are strong alternatives:
	<ul>		<ul>
	<li>One option is to find a professional virtual conference organizer that runs everything (including running the website), as well as the videos. We were unable to find such, so we don't know if this is possible		<li>One option is to find a professional virtual conference organizer that runs everything (including running the website), as well as the videos. We were unable to find such, so we don't know if this is possible.
	<li>		<li>
	SlidesLive seemed better for our needs than the alternative we considered		SlidesLive seemed better for our needs than the alternative we considered

Jurafsky: /* ACL 2020 post-conference report: General Chair */

2020-07-23T20:03:19Z

ACL 2020 post-conference report: General Chair

← Older revision		Revision as of 20:03, 23 July 2020
Line 17:		Line 17:
	<li>The team was awesome!! Every set of chairs was amazing and rose to the occasion to deal with the shift to virtual.		<li>The team was awesome!! Every set of chairs was amazing and rose to the occasion to deal with the shift to virtual.
	<li>This year we added publicity team in China, important for reaching out to a large audience there.		<li>This year we added publicity team in China, important for reaching out to a large audience there.
			<li>This year (as last year) we got CC-BY4.0 permissions from authors to upload their videos of talks to the ACL Anthology. New this year, we also uploaded transcripts of the talks, making the videos more accessible, first asking authors to correct the ASR transcripts of their talks. We need a way to encourage more authors to correct their transcripts.
	</ul>		</ul>
	<b>Negative:</b>		<b>Negative:</b>
Line 78:		Line 79:
	<ul>		<ul>

	<li>~~We think~~ the ACL should ~~probably~~ not ~~use~~ SlidesLive going forward. They caused a number of problems:		<li>While SlidesLive had many advantages, in the end our advice
			is that ACL should strongly consider not using SlidesLive going forward. They caused a number of problems:
	<ul>		<ul>
	<li>They initially gave us the impression they would handle creating all the zoom rooms for the conference, then changed their mind		<li>They initially gave us the impression they would handle creating all the zoom rooms for the conference, then changed their mind
Line 101:		Line 103:
	<li>However, we don't know if there are strong alternatives:		<li>However, we don't know if there are strong alternatives:
	<ul>		<ul>
	<li>One option is to find a professional virtual conference organizer that runs everything (including running the website), as well as the videos. We were unable to find such, so I don't know if this is ~~poissible~~		<li>One option is to find a professional virtual conference organizer that runs everything (including running the website), as well as the videos. We were unable to find such, so we don't know if this is possible
	<li>		<li>
	SlidesLive seemed better for our needs than the alternative we considered		SlidesLive seemed better for our needs than the alternative we considered
Line 107:		Line 109:
	and then they were the conference for ICLR and the ICLR chairs seemed happy with them;		and then they were the conference for ICLR and the ICLR chairs seemed happy with them;
	we didn't find a lot of alternative options at that point).		we didn't find a lot of alternative options at that point).
	~~<li>~~We assume by now there are probably other options, ~~but inclusion is extremely important to keep in mind~~		We assume by now there are probably other options.
	~~(making it possible~~ to record for folks ~~in countries without ability~~ to buy video recording software), as		<li>In general, a recording company like SlidesLive has advantages over asking
	~~is having~~ professionals ~~deal~~ with ~~the~~ livestream ~~events, and~~ slideslive also checked ~~every video~~ by hand for sound and composition problems		participants to just record themselves: consistency, affordability to participants (no need for folks to buy video recording software),
			professionals dealing with problems in livestream. slideslive also checked each of the 1500+ videos by hand for sound and composition problems, and ran them through ASR captioning..
	</ul>		</ul>
	<li>Live human captions (CART) were done by ACS Captions who were great. we should ~~use~~ them.		<li>Live human captions (CART) for the livestream plenary events were done by ACS Captions who were great. We should reuse them.
	</ul>		</ul>

Line 118:		Line 121:
	<li>Better ways to create a list of "papers to see" and download entire schedules (instead of downloading one paper-slot at a time)		<li>Better ways to create a list of "papers to see" and download entire schedules (instead of downloading one paper-slot at a time)
	<li>QA sessions could possibly be improved by incorporating more poster-like elements (like having speakers do 5-minute spiels every 30 minutes or etc)		<li>QA sessions could possibly be improved by incorporating more poster-like elements (like having speakers do 5-minute spiels every 30 minutes or etc)
	<li>Speakers should upload their slides as well as the talks		<li>Speakers should upload their slides as well as the talks.
	<li>How to do virtual live sessions: work out methods for taking questions, probably involving 2 moderators who screen and present questions		<li>How to do virtual live sessions: work out methods for taking questions, probably involving 2 moderators who screen and present questions
	(and so as to avoid the "more of a comment than a question" people)		(and so as to avoid the "more of a comment than a question" people)
Line 124:		Line 127:
	about how to deal with delay.		about how to deal with delay.
	<li> Fix miniconf so that the whole website (including workshops, plenary pages, etc) can shift timezone, not just the schedule page.		<li> Fix miniconf so that the whole website (including workshops, plenary pages, etc) can shift timezone, not just the schedule page.
	<li>~~Nitin's suggestion: "use one of the many~~ bot ~~frameworks~~ (Rasa, BotKit, Botpress, Hubot) ~~to make a simple FAQ bot that can answer repeated questions"~~		<li>Perhaps building an FAQ bot that can answer repeated questions using a standard toolkit (Rasa, BotKit, Botpress, Hubot); suggestion from Nitin Madnani.

	</ul>		</ul>
Line 130:		Line 133:
	====Getting more Author Permissions:====		====Getting more Author Permissions:====
	<ul>		<ul>
			<li>This year (as last year) we got CC-BY4.0 permissions from authors to upload their videos of talks to the ACL Anthology. In addition, we asked authors to correct the ASR transcripts of their talks, and we are also uploading the transcripts to the Anthology.
	<li> Decide whether to ask/require people for permission to record their chat conversations		<li> Decide whether to ask/require people for permission to record their chat conversations
	<li>Explicitly require people to give permission to store the captions of their videos		<li>Explicitly require people to give permission to store the captions of their videos
Line 157:		Line 161:


	<p><b>Historical note: switching to Virtual: Timeline of Decision to go online:</b>		<p><b>Historical note in case useful: switching to Virtual: Timeline of Decision to go online:</b>
	<ul>		<ul>
	<li>Feb 5: Concern about coronavirus expressed by Seattle Convention and Tourist board.		<li>Feb 5: Concern about coronavirus expressed by Seattle Convention and Tourist board.

Jurafsky: /* ACL 2020 post-conference report: General Chair */

2020-07-23T02:33:02Z

ACL 2020 post-conference report: General Chair

← Older revision		Revision as of 02:33, 23 July 2020
Line 36:		Line 36:
	Probably we should rethink this structure; maybe make demo chairs a kind of area chair?		Probably we should rethink this structure; maybe make demo chairs a kind of area chair?
	And move SRW to the workshop days?		And move SRW to the workshop days?
			<li>Workshops were much less well dealt with on our virtual site than the rest of the conference, since they all
			finalized their scheduled very late and we weren't able to get their infrastructure (web pages, schedules, zoom links) created
			sufficiently.
			<li>It would have been great to have been able to make the website visible a few days earlier,
			to let people start watching papers.
	</ul>		</ul>

Line 112:		Line 116:
	====Switching to Virtual: Other Advice on Infrastructure ====		====Switching to Virtual: Other Advice on Infrastructure ====
	<ul>		<ul>
			<li>Better ways to create a list of "papers to see" and download entire schedules (instead of downloading one paper-slot at a time)
	<li>QA sessions could possibly be improved by incorporating more poster-like elements (like having speakers do 5-minute spiels every 30 minutes or etc)		<li>QA sessions could possibly be improved by incorporating more poster-like elements (like having speakers do 5-minute spiels every 30 minutes or etc)
	<li>Speakers should upload their slides as well as the talks		<li>Speakers should upload their slides as well as the talks
Line 118:		Line 123:
	<li>if you use slideslive or any such operator that uses a delay for transcription, need more training of each speaker		<li>if you use slideslive or any such operator that uses a delay for transcription, need more training of each speaker
	about how to deal with delay.		about how to deal with delay.
	<li> ~~minor: if you use~~ miniconf~~, fix~~ so that the whole website can shift timezone.		<li> Fix miniconf so that the whole website (including workshops, plenary pages, etc) can shift timezone, not just the schedule page.
	<li>Nitin's suggestion: "use one of the many bot frameworks (Rasa, BotKit, Botpress, Hubot) to make a simple FAQ bot that can answer repeated questions"		<li>Nitin's suggestion: "use one of the many bot frameworks (Rasa, BotKit, Botpress, Hubot) to make a simple FAQ bot that can answer repeated questions"

Line 132:		Line 137:
	====Global Inclusion:====		====Global Inclusion:====
	<ul>		<ul>
	<li>For videos (and docs and chats), decide whether to solve problem of viewability in China, Indonesia, Vietnam, etc.,		<li>For videos (and docs and chats), decide whether to (a) solve problem of viewability in China, Indonesia, Vietnam, etc.,
	or ~~else~~ continue to require VPNs.		or (b) continue to require that people in those countries use VPNs.
	<ul>		<ul>
	<li> Vimeo (used by ACL Anthology and also SlidesLive pre-recorded talks) is <b>not</b> visible in China, Indonesia, Vietnam		<li> Vimeo (used by ACL Anthology and also SlidesLive pre-recorded talks) is <b>not</b> visible in China, Indonesia, Vietnam
Line 140:		Line 145:
	<li>Iran is a particularly difficult case, can't use Google or Microsoft either		<li>Iran is a particularly difficult case, can't use Google or Microsoft either
	<li> Proposal: we should assume that any single technology could be banned at any time by some government,		<li> Proposal: we should assume that any single technology could be banned at any time by some government,
	so we should set up mirrors.		so we should set up mirrors for videos.
	</ul>		</ul>

Line 146:		Line 151:
	<ul>		<ul>
	<li>Require an ethics statement of all papers, add ethics to reviewing form, and		<li>Require an ethics statement of all papers, add ethics to reviewing form, and
	add ethics, and also diversity & inclusion to all paper award decision criteria.		add ethics and also diversity & inclusion to all paper award decision criteria.
	<li>Probably need an ethics chair		<li>Probably need an ethics chair (and then need to decide which things are PCC and which are ethics)
	</ul>		</ul>

Jurafsky: /* Global Inclusion: */

2020-07-22T19:09:27Z

Global Inclusion:

← Older revision		Revision as of 19:09, 22 July 2020
Line 135:		Line 135:
	or else continue to require VPNs.		or else continue to require VPNs.
	<ul>		<ul>
	<li> Vimeo (used by ACL Anthology and also SlidesLive pre-recorded talks) not visible in China, Indonesia, Vietnam		<li> Vimeo (used by ACL Anthology and also SlidesLive pre-recorded talks) is <b>not</b> visible in China, Indonesia, Vietnam
	<li>SlidesLive livestream (but not pre-recorded, which uses Vimeo) <b>is</b> is visible in China		<li>SlidesLive livestream (but not pre-recorded, which uses Vimeo) <b>is</b> visible in China
	</ul>		</ul>
	<li>Iran is a particularly difficult case, can't use Google or Microsoft either		<li>Iran is a particularly difficult case, can't use Google or Microsoft either

Jurafsky: /* Switching to Virtual: Advice on Software Partners */

2020-07-22T19:08:44Z

Switching to Virtual: Advice on Software Partners

← Older revision		Revision as of 19:08, 22 July 2020
Line 105:		Line 105:
	<li>We assume by now there are probably other options, but inclusion is extremely important to keep in mind		<li>We assume by now there are probably other options, but inclusion is extremely important to keep in mind
	(making it possible to record for folks in countries without ability to buy video recording software), as		(making it possible to record for folks in countries without ability to buy video recording software), as
	is having professionals deal with the livestream events.		is having professionals deal with the livestream events, and slideslive also checked every video by hand for sound and composition problems
	~~<li>Slideslive~~ also checked every video for sound ~~or other~~ problems
	</ul>		</ul>
	<li>Live human captions (CART) were done by ACS Captions who were great. we should use them.		<li>Live human captions (CART) were done by ACS Captions who were great. we should use them.

Jurafsky: /* Switching to Virtual: Advice on Software Partners */

2020-07-22T19:07:34Z

Switching to Virtual: Advice on Software Partners

← Older revision		Revision as of 19:07, 22 July 2020
Line 80:		Line 80:
	too late to create all the zoom rooms for the workshops.		too late to create all the zoom rooms for the workshops.
	<li>They initially gave us the impression that they would do human captioning of live sessions, but then changed to ASR captioning		<li>They initially gave us the impression that they would do human captioning of live sessions, but then changed to ASR captioning
	<li>They clearly struggled with processing 1500+ video presentations in just around 2 weeks; they also changed their commitment to what they were planning to deliver in terms of captioning multiple times during the pre-conference period~~\\\~~		<li>They clearly struggled with processing 1500+ video presentations in just around 2 weeks; they also changed their commitment to what they were planning to deliver in terms of captioning multiple times during the pre-conference period
	<li>Their setup for allowing authors to correct captions was not easy to use.		<li>Their setup for allowing authors to correct captions was not easy to use.
	<li>Their recording setup didn't allow any author editing, which made it frustrating to have		<li>Their recording setup didn't allow any author editing, which made it frustrating to have