Details
-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 0.2
-
Fix Version/s: None
-
Component/s: Core, Interpreter
-
Labels:None
Description
livy-server will read the livy-repl address from driver. Now it read it from the driver process stdout. But if it is yarn-cluster mode, the driver is in a remote machine that it can not read its stdout.
private val stdoutThread = new Thread { override def run() = { val regex = """Starting livy-repl on (https?://.*)""".r val lines = process.inputIterator // Loop until we find the ip address to talk to livy-repl. @tailrec def readUntilURL(): Unit = { if (lines.hasNext) { val line = lines.next() line match { case regex(url_) => url = new URL(url_) case _ => readUntilURL() } } } readUntilURL() } }