java - Spark sql with hive table delta support -


as latest version of spark (2.1.0) lists unsupported major functionality of hive like:

tables buckets: bucket hash partitioning within hive table partition. spark sql doesn’t support buckets yet.

it means hive tables have bucketed column structure won't loaded dataframe processed properly. there workaround achieve such functionality via jdbc, temp tables , etc. main question how achieve full control using spark sql on tables materialized deltas ?


Comments

Post a Comment

Popular posts from this blog

4x4 Matrix in Python -

im trying code 4x4 matrix in python random integers 1-4. thats easy enough problem want each row , each column 1 time uses of each digit 1-4 example 1 2 3 4 2 3 4 1 3 4 1 2 4 1 2 3 my code 33% of time in loop there happens somthing this 2 1 4 3 3 4 2 1 1 3 x <-------- because of programm cant contiune , end in infinity loop helb how can out? code below """ programm playing game skyline """ random import randrange row1 = [] row2 = [] row3 = [] row4 = [] allrows = [row1, row2, row3, row4] column1 = [] column2 = [] column3 = [] column4 = [] allcolumns = [column1, column2, column3, column4] def board(): in range(4): j = 0 while len(allrows[i]) != 4: x = randrange(1,5) print(i, j) if x not in allrows[i] , x not in allcolumns[j]: allrows[i].append(x) allcolumns[j].append(x) j += 1 else: continue boa...
Read more

wso2is - WSO2 IS 5.0.0 SP1 After restart there is authentication error -

i have configured service provider sso saml2 web sso configuration. the single sign on & logout working fine, when logout , leave browser on login page of wso2 is, , restart wso2 is, when type username/password login in page left open in wso2 is, following error occurs: tid: [0] [is] [2017-03-28 08:03:29,462] debug {org.wso2.carbon.identity.application.authentication.framework.util.frameworkutils} - authentication context null {org.wso2.carbon.identity.application.authentication.framework.util.frameworkutils} tid: [0] [is] [2017-03-28 08:03:29,462] debug {org.wso2.carbon.identity.application.authentication.framework.handler.request.impl.defaultrequestcoordinator} - session data key : cbd70356-49e3-423d-8542-3d4a0c7ad2c6 {org.wso2.carbon.identity.application.authentication.framework.handler.request.impl.defaultrequestcoordinator} tid: [0] [is] [2017-03-28 08:03:29,462] error {org.wso2.carbon.identity.application.authentication.framework.handler.request.impl.defaultreques...
Read more

python - String indices must be integers and while issue -

i writing code school homework. assignment this: write code read book codes till "000" entered , split books 2 categories depending on first 4 digits entered isbn , issn. note : use str , check prefix of code (in case isbn , issn). here code: bookarray = [] booknumber = str(input("give me book code - type 000 if want cancel")) while booknumber != "000": bookarray.append(booknumber) booknumber = str(input("give me book code - type 000 if want cancel")) if booknumber[0,4] == "isbn": isbnarray = booknumber elif booknumber[0,4] == "issn": issnarray = booknumber print(issnarray) print(isbnarray) any regarding same appreciated! in first year in python @ school. edit: expected output should 2 lists books' code numbers. currently, face autonomous loop on "while" not sure of how , why. if booknumber[0,4] == "isbn": you're passing tuple index booknumber ex...
Read more