Bulk Operation

HIVE-7926 LLAP: Tez counters for LLAP 2

HIVE-7926 LLAP: update errata for bad branch commits

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: Make explainuser_1.q test consistent

HIVE-7926 LLAP: merge master into branch

HIVE-7926 Add javadoc for methods added to public APIs

HIVE-7926 LLAP: merge master into branch

HIVE-7926 UGI instances being used in IO elevator threads are incorrect

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: Merge master into branch

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: Merge master to branch

HIVE-7926 Llap: Disable web app for mini llap tests

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: Merge branch to hive-2.0

HIVE-7926 LLAP: Update golden files for orc_llap and llapdecider tests

HIVE-7926 LLAP: Typo in webapps causing initialization error for MiniLlap tests

HIVE-7926 LLAP: Update llap golden files after master merge

HIVE-7926 LLAP: Merge master into branch (for HIVE-11860)

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: Remove unused/old golden files

HIVE-7926 LLAP: Fix discrepancies with metadata_only_queries_with_filters.q

HIVE-7926 LLAP: Fix ordering difference in acid_vectorization_partition.q

HIVE-7926 LLAP: Update errata.txt for HIVE-11871

HIVE-7926 LLAP: Fix auto_join_nulls.q,auto_sortmerge_join_6.q test diffs

HIVE-7926 LLAP: Plan is different for insert1.q

HIVE-7926 LLAP: Partition column value different for identity_project_remove_skip.q

HIVE-7926 LLAP: Remove fileformat_mix.q.out as it is not part of tez test suite

HIVE-7926 LLAP: constprog_dpp.q,explainuser_1.q showing explain diff

HIVE-7926 LLAP: Fix unionDistinct_1.q and union_view.q

HIVE-7926 LLAP: Generate join0.q golden file for java 8

HIVE-7926 LLAP: Analyze and fix vectorization tests

HIVE-7926 LLAP: Fix tests related to stats difference

HIVE-7926 LLAP: Test failures - file.splitmetainfo file not found

HIVE-7926 LLAP: Fix failing tests in MiniLlapCluster

HIVE-7926 LLAP: Rerunning MiniLlap does not start as web app port is used

HIVE-7926 LLAP: Merge master into branch

HIVE-7926 LLAP: Exception is ignored if MiniLlap cluster fails to start

HIVE-7926 LLAP: TaskCommunicator should not register MultiMRInput Inputs for state updates

HIVE-7926 LLAP: MiniLlapCluster tests are slow

HIVE-7926 LLAP: Generate golden files for all MiniLlapCluster tests

HIVE-7926 LLAP: Create webapp/llap directory for MiniLlapCluster

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: Remove MiniLlapCluster from shim layer after hadoop-1 removal

HIVE-7926 LLAP: MiniLlapCluster integration broke hadoop-1 build

HIVE-7926 LLAP: merge master into branch

HIVE-7926 TaskExecutorService can reject work even if capacity is available

HIVE-7926 LLAP: Merge master into branch

HIVE-7926 LLAP: Update tez version to fix build

HIVE-7926 LLAP: merge master into branch

HIVE-7926 Create LLAP Monitor Daemon class and launch scripts

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: make sure tests pass #3

HIVE-7926 LLAP: switch the branch to Tez master from branch

HIVE-7926 Allow wait queue comparator to be specified as a classname

HIVE-7926 LLAP: Some counters are incorrect

HIVE-7926 LLAP: move EncodedTreeReaderFactory, TreeReaderFactory bits that rely on orc.encoded, and StreamUtils if needed, to orc.encoded package

HIVE-7926 LLAP: implement LLAP UI as a separate service - part 1

HIVE-7926 LLAP: tez.runtime.compress doesn't appear to be honored for LLAP

HIVE-7926 LLAP: Fix API usage to work with evolving Tez APIs - TEZ-2678

HIVE-7926 Disabling llap cache allocate direct is not honored anymore

HIVE-7926 LLAP: ORC-related refactoring changes broke something

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: make sure JMX view is correct

HIVE-7926 LLAP: Fix API usage to work with evolving Tez APIs - TEZ-{2651,2652,2653}

HIVE-7926 LLAP: clean up ORC dependencies - move encoded reader path into a separate package and reader

HIVE-7926 LLAP: move LlapConfiguration into HiveConf and document the settings

HIVE-7926 LLAP: Fix API usage to work with evolving Tez APIs - TEZ-2005

HIVE-7926 LLAP: Fix API usage to work with evolving Tez APIs

HIVE-7926 LLAP: Hybrid Map-join cache returns invalid data

HIVE-7926 LLAP: clean up ORC dependencies on object pools

HIVE-7926 LLAP: Register for finishable state change notifications when adding a task instead of when scheduling it

HIVE-7926 LLAP: Execution order within LLAP daemons should consider query-specific priority assigned to fragments

HIVE-7926 LLAP: investigate locality issues

HIVE-7926 LLAP: PipelineSorter got stuck

HIVE-7926 LLAP: TaskExecutorService state is not cleaned up

HIVE-7926 LLAP: NPE in AMReporter

HIVE-7926 LLAP: clean up ORC dependencies part 1

HIVE-7926 LLAP: Fix the LLAP to ORC APIs

HIVE-7926 LLAP: occasional NPE in parallel queries in ORC reader

HIVE-7926 LLAP: more out file changes compared to master

HIVE-7926 LLAP: Cache BuddyAllocator throws NPE

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: clean up shuffle directories when DAG completes

HIVE-7926 Remove unused LlapUtils class from ql.io.orc

HIVE-7926 LLAP: spark out file changes compared to master

HIVE-7926 Fair ordering of fragments in wait queue

HIVE-7926 LLAP: more out file changes compared to master

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: Cache arena size rounding

HIVE-7926 LLAP: SIGSEGV in Off-heap decompression routines

HIVE-7926 LLAP: fix TestLlapTaskSchedulerService flakiness

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: disable the flaky TestLlapTaskSchedulerService test

HIVE-7926 MiniTez mergejoin test fails with Tez input error (issue in merge join under certain conditions)

HIVE-7926 LLAP: MiniTez tez_smb_main, tez_bmj_schema_evolution fail with NPE

HIVE-7926 LLAP: some MiniTez tests have result changes compared to master

HIVE-7926 LLAP: fix some tests in the branch and revert incorrectly committed changed out files (from HIVE-11014)

HIVE-7926 LLAP: test auto_sortmerge_join_5 on MiniTez fails with NPE

HIVE-7926 LLAP: fix TestMiniTezCliDriverLocal on the branch

HIVE-7926 LLAP: Fix LLAP startup issues due to heap rounding errors

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: make sure tests pass #2

HIVE-7926 LLAP: Accept --hiveconf parameters for the LlapServiceDriver

HIVE-7926 LLAP: ShuffleHandler + Submit work init race condition

HIVE-7926 LLAP: Allow finer control of startup options for LLAP

HIVE-7926 LLAP: preemption appears to count against failure count for the task

HIVE-7926 LLAP: recent optimization introduced wrong assert to elevator causing test to fail

HIVE-7926 LLAP: expose what's running on the daemon thru JMX

HIVE-7926 LLAP: make ObjectCache for plans work properly in the daemon

HIVE-7926 LLAP: merge master to branch

HIVE-7926 LLAP: Set java.io.tmpdir correctly for LLAP Slider instance

HIVE-7926 LLAP: elevator reads some useless data even if all RGs are eliminated by SARG

HIVE-7926 LLAP: fix hadoop-1 build for good by removing llap-server from hadoop-1 build

HIVE-7926 LLAP: cache QF counters have a wrong value for consumer time

HIVE-7926 LLAP: Exception in InputInitializer when creating HiveSplitGenerator

HIVE-7926 LLAP: merge master into branch

HIVE-7926 LLAP: ArrayIndexOOB exception in new mapjoin

HIVE-7926 LLAP: the return of the stuck DAG

HIVE-7926 LLAP: make sure the branch builds on hadoop-1: part 1 (non-llap)

HIVE-7926 LLAP: HIVE-10778 has NPE

HIVE-7926 LLAP: Fixes to TaskReporter after recent Tez changes

HIVE-7926 LLAP: make sure tests pass #1

HIVE-7926 LLAP: bug in split processing in IO elevator causes duplicate rows

HIVE-7926 LLAP: Merge from trunk May 28th 2015

HIVE-7926 LLAP: Serialize handling of requests / events for a query within daemons

HIVE-7926 LLAP: Better handling of hostnames when sending heartbeats to the AM

HIVE-7926 LLAP: preemption in AM due to failures / out of order scheduling

HIVE-7926 LLAP: DAGs get stuck in yet another way

HIVE-7926 LLAP: support parallel query compilation in HS2

HIVE-7926 LLAP: Daemons should shutdown in case of fatal errors

HIVE-7926 LLAP: Utilities::gWorkMap needs to be cleaned in HiveServer2

HIVE-7926 LLAP: add pre-fragment and per-table cache details

HIVE-7926 LLAP: perf dips with IO elevator disabled

HIVE-7926 LLAP: Improve the way task finishable information is processed

HIVE-7926 LLAP: Exception reported while trying to kill a task

HIVE-7926 LLAP: NPE when calling abort on the TezProcessor

HIVE-7926 LLAP: Wait queue scheduler goes into tight loop

HIVE-7926 LLAP: Provide current attempt start time for wait queue ordering

HIVE-7926 LLAP: Kill any fragments running in a daemon when a query completes

HIVE-7926 LLAP: Add aging to wait queue tasks

HIVE-7926 LLAP: Modify running / wait queues on on fragment finishable state changes

HIVE-7926 LLAP: Misc changes to daemon scheduling

HIVE-7926 LLAP: dags get stuck in yet another way

HIVE-7926 LLAP: rare NPE in IO

HIVE-7926 LLAP: task scheduler thread-count keeps growing

HIVE-7926 LLAP: fix guava stopwatch conflict

HIVE-7926 LLAP: Log additional debug information in the scheduler

HIVE-7926 LLAP: Add counters for time lost per query due to preemption

HIVE-7926 LLAP: DAG got stuck after reducer fetch failed

HIVE-7926 LLAP: DAGs get stuck at start with no tasks executing

HIVE-7926 LLAP: Add a mechanism for daemons to inform the AM about killed tasks

HIVE-7926 LLAP: Make use of the task runner which allows killing tasks

HIVE-7926 LLAP: Update tez dependency

HIVE-7926 LLAP: Wait queue pre-emption

HIVE-7926 LLAP: investigate why GC with IO elevator disabled is so bad

HIVE-7926 LLAP: registry logs strange lines on daemons

HIVE-7926 LLAP: AM task communication retry is too long

HIVE-7926 LLAP: AM gets stuck completely if one node is dead

HIVE-7926 LLAP: registry; Tez attempted to schedule to daemon that didn't exist

HIVE-7926 LLAP: allocator occasionally has a spurious failure to allocate due to "partitioned" locking and has to retry

HIVE-7926 LLAP: Invalid containerId prefix

HIVE-7926 LLAP: Vector row extraction allocates new extractors per process method call instead of just once

HIVE-7926 LLAP: Native Vector Map Join doesn't handle filtering and matching on LEFT OUTER JOIN repeated key correctly

HIVE-7926 LLAP: a different NPE in shuffle

HIVE-7926 LLAP: Add test case for all row groups selection with no column projection

HIVE-7926 LLAP: Cleanup map join cache when a query completes

HIVE-7926 LLAP: Must reset small table result columns for Native Vectorization of Map Join

HIVE-7926 LLAP: Empty PPD splits from Cache throw error

HIVE-7926 LLAP: Resolve everything in llap-daemon-site.xml

HIVE-7926 LLAP: AsertionError cannot allocate when reading from orc

HIVE-7926 LLAP: Tez task is interrupted for unknown reason after an IPC exception and then fails to report completion

HIVE-7926 LLAP: Minor fixes after tez api enhancements for dag completion

HIVE-7926 LLAP: investigate why TPCH Q1 1k is slow

HIVE-7926 LLAP: NPE in IO when returning 0 rows with no projection

HIVE-7926 LLAP: fix container sizing configuration for memory

HIVE-7926 LLAP: Consider replacing BytesBytesMultiHashMap with new fast hash table code of Native Vector Map Join

HIVE-7926 LLAP: Abort hive tez processor on interrupts

HIVE-7926 LLAP: Limit number of threads used to communicate with a single LLAP instance to 1

HIVE-7926 LLAP: Factor known capacity into scheduling decisions

HIVE-7926 LLAP: NPE caused by HIVE-10397

HIVE-7926 LLAP: NPE in scheduler in case of rejected tasks

HIVE-7926 LLAP: Make use of additional information to determine run/preemption order

HIVE-7926 LLAP: Provide runtime information to daemons to decide on preemption order

HIVE-7926 LLAP: scheduling occasionally schedules all the work on one machine

HIVE-7926 LLAP: Implement Tez SplitSizeEstimator for Orc

HIVE-7926 LLAP: Notify AM of pre-emption

HIVE-7926 LLAP: query 54 doesn't finish in LLAP

HIVE-7926 LLAP: Tez in-place UI gets misaligned when state is TERMINATING

HIVE-7926 LLAP: Name IO elevator threads

HIVE-7926 LLAP: query80 fails with vectorization cast issue

HIVE-7926 LLAP: randomness in random machine scheduling is not random enough

HIVE-7926 LLAP: merge trunk to branch 2015-04-15

HIVE-7926 LLAP: small improvement to unlocking cache data

HIVE-7926 LLAP: IndexOutOfBound in MapJoinOperator

HIVE-7926 LLAP: Self-joins with the cache enabled

HIVE-7926 LLAP: NPE due to failure to find position

HIVE-7926 Hadoop reflectionutils has issues

HIVE-7926 LLAP: Cache cleaner throws Negative sleep exception

HIVE-7926 LLAP: Fix timeouts for tasks which stay in the pending queue

HIVE-7926 LLAP: Handle errors while sending source state updates to the daemons

HIVE-7926 LLAP: Allow the runtime to check whether a task can run to completion

HIVE-7926 LLAP: Explain plan diff in llap_partitioned.q test case

HIVE-7926 LLAP: orc_llap test fails again

HIVE-7926 LLAP: Fix merge conflicts related to HIVE-10067

HIVE-7926 LLAP: Make use of the timed version of getDagStatus in TezJobMonitor

HIVE-7926 LLAP: Certain errors are not reported to the AM when a fragment fails

HIVE-7926 LLAP: Clean up encoded ORC tree readers after trunk merge

HIVE-7926 LLAP: Loglevel for daemons as a startup option

HIVE-7926 LLAP: Support caching of uncompressed ORC data

HIVE-7926 Move fragment execution onto a thread pool

HIVE-7926 LLAP: start fetching earlier

HIVE-7926 LLAP: Failures from TaskRunnerCallable should be reported

HIVE-7926 LLAP: LLAP IO doesn't get invoked inside MiniTezCluster q tests

HIVE-7926 LLAP: ORC MemoryManager is singleton synchronized

HIVE-7926 LLAP: general cache deadlock avoidance

HIVE-7926 LLAP: ORC BIGINT SARGs regressed after Parquet PPD fixes (HIVE-8122)

HIVE-7926 LLAP: Avoid deserializing the plan > 1 times in a single thread

HIVE-7926 LLAP: ORC file contains compression buffers larger than bufferSize (OR reader has a bug)

HIVE-7926 LLAP: Varchar columns are not handled in encoded readers

HIVE-7926 LLAP: switch to sensible cache policy

HIVE-7926 LLAP: GC issues 1

HIVE-7926 LLAP: Tez heartbeats are delayed by ~500+ ms due to Hadoop IPC client

HIVE-7926 LLAP: BytesBytesMultiHashMap and mapjoin container should reuse refs

HIVE-7926 LLAP: Fix ordering of execution modes

HIVE-7926 LLAP: Port changes to timestamp stream reader after timezone fix in trunk

HIVE-7926 LLAP: Print execution modes in tez in-place UI

HIVE-7926 LLAP: Use task number, attempt number to cache plans

HIVE-7926 LLAP: reducers running in LLAP starve out map retries

HIVE-7926 LLAP: query 17 tasks fail due to mapjoin issue

HIVE-7926 LLAP: query 7 produces corrupted result with IO enabled

HIVE-7926 LLAP: port updates from HIVE-9555 to llap branch in preparation for trunk merge

HIVE-7926 LLAP: implement stopping the reader thread

HIVE-7926 LLAP: Generate consistent splits and locations for the same split across jobs

HIVE-7926 LLAP: Cancelling tasks fails to stop cache filling threads

HIVE-7926 LLAP: enable yourkit profiling of tasks

HIVE-7926 LLAP: improve how buffers are locked for split

HIVE-7926 LLAP: Make the low-level IO threadpool configurable

HIVE-7926 LLAP: Object Estimator digs in via a deep hashCode()

HIVE-7926 LLAP: adjust allocation after decompression